Slow or no internet in the afternoons

I have the fastest internet speed on my plan.

But almost every afternoon the internet is spotty or not working at all.

Usually the internet works fine until lunch, but in the afternoons it is nonexistent.

I know its not my connection.  Is it due to traffic from other people or due to my xfinity equipment?