Email change associate with another account

I am trying to add my email address onto my Xfinity primary user account. When I try to add the address it says "This email address is already associated with an Xfinity account." I did have a secondary user that referenced that email address. I have deleted the secondary user but I still get the error message.  How can this be fixed?