Latency variation, packet loss

I've had an issue with latency for the past several months. I've had 2 techs out, but my line came back clean. One did send a request to maintenance to work on my node because it showed something which I was hoping would fix it but it didn't. Below is a couple examples of what's going on, I've pinged Google and the first hop after my modem for reference.

GOOGLE

Ping statistics for 2607:f8b0:400a:804::200e:
Packets: Sent = 200, Received = 196, Lost = 4 (2% loss),
Approximate round trip times in milli-seconds:
Minimum = 13ms, Maximum = 192ms, Average = 43ms

FIRST HOP

Ping statistics for 2001:558:4082:4a::1:
Packets: Sent = 296, Received = 296, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 6ms, Maximum = 260ms, Average = 20ms

I generally notice this when playing games and a latency variation symbol appears, buffering when streaming, or while trying to work and VOIP apps have issues. This issue seems random, but I do notice it more during the day, could it be congestion? My modem levels look good according to Comcast. Any help is appreciated.