Constant Packet Loss from Indonesia over SIN Datacenter (AS13335 / AS55518)

Hi there, we noticed high packet loss (between 35-60%)

|------------------------------------------------------------------------------------------|
| WinMTR statistics |

Host - % Sent Recv Best Avrg Wrst Last
redacted - 1 928 927 1 3 113 3
redacted - 2 887 875 1 4 123 3
ae-1-36-r1-dps1.globalxtreme.net - 1 924 922 2 8 124 3
ae-0-9-r1-jkt1.globalxtreme.net - 0 932 932 18 23 138 22
ae-2-0-r1-sg1.globalxtreme.net - 1 920 917 35 40 239 37
cloudflare.sgix.sg - 48 325 171 0 41 185 35
162.158.160.19 - 0 931 931 34 40 240 36
172.67.196.70 - 1 928 927 32 36 219 33
________________________________________________ ______ ______ ______ ______ ______ ______
WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider

on cloudflare.sgix.sg

All tests for one.one.one.one and cloudflare.com are working fine.
Also speed.cloudflare.com shows: no packet loss

Also we noticed https://radar.cloudflare.com/as55518 for cloudflare.sgix.sg shows no traffic at all but traffic on original source shows traffic signals: https://www.sgix.sg/statistics/sgix-aggregate-daily.png

Testing with VPN from another location in Europe no packet loss has been visible:

|------------------------------------------------------------------------------------------|
| WinMTR statistics |

Host - % Sent Recv Best Avrg Wrst Last
redacted - 0 46 46 376 532 1309 381
gateway.reserved.gmhost.hosting - 0 46 46 377 572 1147 402
ae0.3903.edge2.fra3.de.first-colo.net - 0 46 46 376 561 1147 401
ffm-b11-link.ip.twelve99.net - 0 46 46 376 564 1148 401
cloudflare-ic-328337.ip.twelve99-cust.net - 0 46 46 379 571 1147 401
172.69.148.3 - 0 46 46 376 566 1147 401
188.114.96.3 - 0 46 46 376 557 1147 386
________________________________________________ ______ ______ ______ ______ ______ ______
WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider

Thanks for help

The problems still appear for access from different points in Asia (Indonesia, Sri Lanka, India). Duration of this incident is now present since roughly around 24-36 hours.

You might check similarities to this recent ticket here:

We have conducted further tests with other Indonesia ISP which are routing also via other Singapore Cloudflare node: https://radar.cloudflare.com/as13335. The result is the same with package loss up to 90%.

Is someone from Cloudflare team reading here to help?

|------------------------------------------------------------------------------------------|
| WinMTR statistics |

Host - % Sent Recv Best Avrg Wrst Last
10.8.1.1 - 0 40 40 21 58 118 38
103.77.107.129 - 0 40 40 21 60 142 83
69.236.65.in-addr.arpa - 0 40 40 21 68 142 83
103.155.156.61 - 7 32 30 22 56 109 54
103.143.223.9 - 7 32 30 24 69 136 54
103.11.29.48 - 7 32 30 36 65 113 41
13335.sgw.equinix.com - 64 11 4 0 82 151 151
172.70.146.3 - 7 32 30 35 73 109 54
104.21.3.41 - 17 24 20 35 62 144 144
________________________________________________ ______ ______ ______ ______ ______ ______
WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider

As soon as no routing occurs via Singapore CDN (e.g. Disabled Cloudflare proxy for target IP), no issues occur.

So kindly look into Singapore nodes.

|------------------------------------------------------------------------------------------|
| WinMTR statistics |

Host - % Sent Recv Best Avrg Wrst Last
redacted - 2 62 61 0 2 18 1
10.22.48.1 - 4 62 60 0 4 18 2
ae-1-36-r1-dps1.globalxtreme.net - 2 66 65 0 8 76 5
ae-0-3-r1-jkt1.globalxtreme.net - 2 62 61 0 26 52 25
ae-1-0-r2-sg1.globalxtreme.net - 2 66 65 0 39 66 39
ipv4.de-cix.fra.de.as34788.all-inkl.com - 4 62 60 0 397 432 396
redacted - 0 69 69 396 398 409 406
________________________________________________ ______ ______ ______ ______ ______ ______
WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider

Hi there,

I would recommend reading over this really helpful guide on how to read and use traceroute:

Packet loss in the middle of a mtr/trace route does not matter if it does not continue to the end/reflect in the last hop. The difference between “To it” vs “Through it”. Overall that pdf is a good read, but if you’re looking for specific pages in reference to this, Page 33 & 36 are of interest.

Unless you’re noticing a specific issue you think is related to this, there probably is no issue. Don’t get too lost in the traceroutes. If you can describe a specific issue you are facing in relation, perhaps the community can help.

If you do notice packet loss that goes all the way through, I would try to reach out to your ISP about it, so they can investigate it and contact the responsible parties if needed.

Hope that helps.

@Chaika Thanks a lot for taking your time. We noticed for some of our pages in development like theworldtravelindex dot com that we have heavy problems to reach them from Indonesia. After investigating to ping this page via MTR we noticed the packet loss. After testing with other Indonesia VPN we could confirm the problems in frontend (timeouts or loading delay of 40-60 seconds) as long as they went through Singapore Cloudflare Center.

Whenever we switched to another VPN location routing through other Cloudflare location we could see in frontend (like in Chrome incognito) as well as in the traceroute no issues in fast loading.

In the first analysis the conclusion is that there is a problem from Indonesia (we tested several ISP) which routes to Singapore. We tested nearby locations with developers in Sri Lanka or India and none of these problems appeared.

If you have other ideas for troubleshooting this issue kindly let us know. Otherwise we would go for Cloudflare Pro temporarily to get dedicated support as we can’t see Cloudflare experts reading on this topic.

Thanks a lot again for taking your time on this topic. We appreciate a lot.