Packet Loss, Low Speeds, and Higher ping all during peak times.

So my internet is ok from 10pm on. But from 5pm -10pm I get packetloss, lower speeds and double the ping. I had comcast down multiply times, the check the modem, check the router and say there's nothing else they can do. I'm guessing they have a spec that if it falls in there it's ok. But is there anything else I can do?