Early termination fee

I have moved and terminated my contract, I understand normally a fee would be assessed if there is xfinity and I don't resign up with xfinity. However I moved in with somebody who already has xfinity so there is no way for me to add xfinity. Should I still be charged an early termination fee? This is not to mention I have been a customer for twenty years. This just feels so wrong.