I dont know how things work in the US but I dont understand how its possible for an ISP to control a device you own?
if you are using the ISP's modem, yeah they probably have an interface to control the device remotely and i understand that - but if you using your own modem, with a different firmware, how are they even gonna access it?