Extreme Latency Issues

Posted this on the reddit, but I thought I'd post here as well since the reddit appears to be completely ignored.

This is happening again this morning as it has happened throughout the day periodically for the last few days. Would you please address the faulty node at cm-1-acr02.castlerock.co.denver.comcast.net

ASA-CR# sh ip

System IP Addresses:

Vlan2 outside 24.9.46.33 255.255.254.0

ASA-CR# sh route

Gateway of last resort is 24.9.46.1 to network 0.0.0.0

ASA-CR# ping outside 24.9.46.1

Sending 5, 100-byte ICMP Echos to 24.9.46.1, timeout is 2 seconds:

!!!!!

Success rate is 100 percent (5/5), round-trip min/avg/max = 10/16/30 ms

C:\Users\auser>tracert 8.8.8.8

Tracing route to dns.google [8.8.8.8]

over a maximum of 30 hops:

1 2 ms 2 ms 4 ms 172.30.254.254

2 1057 ms 692 ms 263 ms cm-1-acr02.castlerock.co.denver.comcast.net [96.120.13.57]

3 66 ms 13 ms 13 ms ae-252-1210-rur02.castlerock.co.denver.comcast.net [96.110.194.109]

4 73 ms 12 ms 15 ms ae-2-rur01.castlerock.co.denver.comcast.net [68.85.89.233]

5 16 ms 17 ms 17 ms ae-10-ar01.denver.co.denver.comcast.net [68.86.104.97]

6 16 ms 12 ms 20 ms be-36021-cs02.1601milehigh.co.ibone.comcast.net [96.110.43.245]

This conversation is no longer open for comments or replies and is no longer visible to community members.

Responses

BruceW

Gold Problem Solver

•

26.5K Messages

5 years ago

@ColoHikerGuy wrote: ...
1 2 ms 2 ms 4 ms 172.30.254.254
2 1057 ms 692 ms 263 ms cm-1-acr02.castlerock.co.denver.comcast.net [96.120.13.57]
3 66 ms 13 ms 13 ms ae-252-1210-rur02.castlerock.co.denver.comcast.net [96.110.194.109]
4 73 ms 12 ms 15 ms ae-2-rur01.castlerock.co.denver.comcast.net [68.85.89.233]
5 16 ms 17 ms 17 ms ae-10-ar01.denver.co.denver.comcast.net [68.86.104.97]
6 16 ms 12 ms 20 ms be-36021-cs02.1601milehigh.co.ibone.comcast.net [96.110.43.245]

The high RTT at hop #2 doesn't extend to later hops, so it's probably not significant. See https://www.dslreports.com/faq/14068. The device at hop #2 is most likely giving low priority to ping and trace packets and higher priority to actual data packets. If it was dropping data packets you would see high RTT and/or packet loss at all the hops beyond that one.

ColoHikerGuy

New Poster

•

2 Messages

5 years ago

If it's shedding packets, ICMP or otherwise, for any reason that reason is not a good one. ICMP packets aren't normally dropped or showing high latency, so clearly there is an intermittent resource issue with the node either causing some pretty harsh queuing to kick in or straight packet hemorraghing.

There was a scheduled maintenance for our area last week. It doesn't appear to have solved the problem:

root@lamp ~# tcptraceroute 108.61.69.68
Selected device eth0, address 172.30.254.7, port 48735 for outgoing packets
Tracing the path to 108.61.69.68 on TCP port 80 (http), 30 hops max
 1  cm-1-acr02.castlerock.co.denver.comcast.net (96.120.13.57)  497.404 ms  20.837 ms  37.435 ms
 2  ae-252-1210-rur02.castlerock.co.denver.comcast.net (96.110.194.109)  26.640 ms  44.179 ms  34.019 ms
 3  ae-2-rur01.castlerock.co.denver.comcast.net (68.85.89.233)  34.076 ms  28.698 ms  33.140 ms
 4  ae-10-ar01.denver.co.denver.comcast.net (68.86.104.97)  27.932 ms  37.669 ms  34.117 ms
 5  be-36041-cs04.1601milehigh.co.ibone.comcast.net (96.110.43.253)  29.283 ms  33.611 ms  31.119 ms
 6  be-1411-cr11.1601milehigh.co.ibone.comcast.net (96.110.39.78)  30.223 ms  19.535 ms *
 7  * be-303-cr11.350ecermak.il.ibone.comcast.net (96.110.37.153) 53.177 ms  52.695 ms
 8  be-1111-cs01.350ecermak.il.ibone.comcast.net (96.110.35.1)  55.865 ms  46.929 ms  49.461 ms
 9  be-1102-cr02.350ecermak.il.ibone.comcast.net (96.110.36.98)  56.612 ms  53.764 ms  60.148 ms
10  be-10305-cr02.newyork.ny.ibone.comcast.net (68.86.85.201)  75.185 ms  76.109 ms  97.455 ms

root@lamp ~# traceroute 108.61.69.68
traceroute to 108.61.69.68 (108.61.69.68), 30 hops max, 60 byte packets
 1  cm-1-acr02.castlerock.co.denver.comcast.net (96.120.13.57)  1313.585 ms  1313.053 ms  1313.469 ms
 2  ae-252-1210-rur02.castlerock.co.denver.comcast.net (96.110.194.109)  1314.247 ms  1314.197 ms  1314.140 ms
 3  ae-2-rur01.castlerock.co.denver.comcast.net (68.85.89.233)  1314.092 ms  1314.021 ms  1313.981 ms
 4  ae-10-ar01.denver.co.denver.comcast.net (68.86.104.97)  1315.879 ms  1320.354 ms  1315.276 ms
 5  be-36011-cs01.1601milehigh.co.ibone.comcast.net (96.110.43.241)  1314.630 ms  1314.575 ms *
 6  be-1411-cr11.1601milehigh.co.ibone.comcast.net (96.110.39.78)  1313.457 ms be-1311-cr11.1601milehigh.co.ibone.comcast.net (96.110.39.74)  730.118 ms be-1411-cr11.1601milehigh.co.ibone.comcast.net (96.110.39.78)  757.825 ms
 7  * * be-301-cr11.350ecermak.il.ibone.comcast.net (96.110.37.145)  303.135 ms
 8  be-1311-cs03.350ecermak.il.ibone.comcast.net (96.110.35.9)  302.339 ms  303.005 ms be-1411-cs04.350ecermak.il.ibone.comcast.net (96.110.35.13)  302.941 ms
 9  be-1202-cr02.350ecermak.il.ibone.comcast.net (96.110.36.102)  304.849 ms  304.776 ms be-1102-cr02.350ecermak.il.ibone.comcast.net (96.110.36.98)  303.917 ms
10  be-10305-cr02.newyork.ny.ibone.comcast.net (68.86.85.201)  320.649 ms  320.568 ms  319.778 ms
11  be-10203-cr01.newark.nj.ibone.comcast.net (68.86.85.185)  321.469 ms  321.423 ms  333.010 ms
12  be-1301-cs03.newark.nj.ibone.comcast.net (96.110.36.89)  331.700 ms  332.774 ms  332.741 ms
^C

Your Home Network

ColoHikerGuy

Extreme Latency Issues

BruceW

ColoHikerGuy

New to the Community?