0.5% to 1% steady stream of packet loss during EST "Work Hours" (around 9am-5pm roughly)

I can get more evidence to support this post but wanted to see if my first premise is true.  I seem to have ruled out any hardware/OS issues, as the problem persists both on ethernet and wifi between various devices in our home.  My next assumption was either router, coaxial cable, or wall jack issues but the problem only occurs during the early/mid daytime hours in the EST timezone.  Since the issue only occurs during active work hours, I'm assuming that has to do with the ISP hardware/load in my area rather than my router/cable/etc?  If this assumption is wrong, I will test different routers and cables first.