My Xfinity internet

When I am connected to my modem from Xfinity at any given time I have several people that appear to be workers in the area that immediately drive by my house to would appear to connect to my WiFi account. Is it possible to be a hot spot and not know it