Cloudflare 504 520 errors on XML Sitemap Generator

[edosan]

I have a XML Sitemap Generator that continues to receive 504 / 520 Cloudflare errors from the Gateway with my identification ID.

(HTTP) 504 Gateway Timeout server error response code indicates that the server did not get a response in time from the upstream server that it needed in order to complete the request. .Apparently the problem is a handshake that is not occurring within a Cloudflare 100 second timeframe. Is there a way that Cloudflare can be set to stop this from occurring.

I am a programming novice and need some suggestions.

Thanks, Ed

[fritex]

@edosan

XML Sitemap Generator

May I ask if this is a plugin for some CMS like WordPress, or self-made script, or rather some online tool like https://www.xml-sitemaps.com/?

@edosan

100 second timeframe

If it’s running at your origin host/server, it might indicate your server needs more resources, or more power, even more time as the error states, to generate it successfully and completly in one batch file with all the URLs (up to 50k items as I remember per XML sitemap file or if more than that it should be split by multiple sitemap files, at least for Google).

I might suggest you to temporary enable the “Pause Cloudflare for this site” option from the Overview tab of the Cloudflare dashboard.
Run the process, after finish, un-pause it.

Other workardoun to try out is by temporary switching the DNS records for your domain name from proxied to (DNS-only).

Nevertheless, if your PHP settings at your origin server has value of 300 or more, even if you got the error “504 timeout” from Cloudflare, I believe the PHP process still works and does his job in the background until it hits that origin value set for timeout despite the error being shown.

• you could try to increase the execution timeout in PHP just in case …

[edosan]

Thank you for your reply.

I am used the https://www.xml-sitemaps.com/ software

The server is networksolutions. I doubt that the origin host/server requires more resources, etc.

The site we are using has less than 2000 pages and is stopped at level 3. It will be only one batch file.

I will try this suggestion. (…suggest you to temporary enable the “Pause Cloudflare for this site”)

I will also try this suggestion. (temporary switching the DNS records for your domain name from proxied to (DNS-only).)

How do I find out if my PHP settings on my origin server has a value of 300 or more?

The execution time is currently set at 12000sec.

Regards and thanks again,

Ed

[AppleSlayer]

@edosan

504

Community Tip - Fixing Error 502 / 504: Bad Gateway

Error Try the suggestions in this Community Tip to help you fix Error 502 / Error 504: Bad Gateway / Gateway Timeout. Background The 502 / 504 errors are quite similar. Generally, a HTTP 502 / 504 errors occurs because your origin server (e.g. your web host) is returning this code to us, and Cloudflare returns this code in turn to your visitors. They are caused by a problem connecting to an upstream server - meaning your server is trying to initiate a process and this fails to work as expecte…

@edosan

[520]

Community Tip - Fixing Error 520: Web server is returning an unknown error

Error Try the suggestions in this Community Tip to help you fix “Error 520: Web server is returning an unknown error”. Background Error 520 is essentially a catch-all response when something unexpected happens or when the origin server incorrectly interprets or does not tolerate a request due to a protocol violation or an empty response. A 520 error occurs when the connection started on the origin web server, but that the request was not completed. The most common reason why this would occur …