Baidu crawler 520 error

Hi all:
I‘m a chinese free plan cloudflare user , and the site host is siteground , we use cloudflare for the cdn.The google and bing crawler works well ,but baidu crawler nothing works. from the baidu official crawler test tool i got the 520 error. and the detail description shows as below:

HTTP/1.1 520 Origin Error
Date: Mon, 27 Apr 2020 08:31:34 GMT
Content-Type: text/html
Transfer-Encoding: chunked
Connection: close
Set-Cookie: __cfduid=da9ab568bce026160d80ef1257e091b091587976293; expires=Wed, 27-May-20 08:31:33 GMT; path=/; domain=[mysite domain]; HttpOnly; SameSite=Lax
Cache-Control: no-store, no-cache
Expect-CT: max-age=604800, report-uri=“
Server: cloudflare
CF-RAY: 58a730195ba005a2-LAX
cf-request-id: 025c5c63db000005a2d3809200000001

pc agent and mobile agent all went wrong,also the sitemaps we sent to baidu still cralws failed . i didn’t set any firewall option . is there something wrong with my site setting or cloudflare cdn do not support baidu crawler ?

this is my site address:
My site address

thanks for helping me!

Just keep in mind that Cloudflare’s usefulness within China is fairly limited since your connections will be going outside of China unless you’re an enterprise using the CF China network (requires an ICP license and a lot of money to get).

As you can see, the crawler is going to LAX - Los Angeles, California:

As for this specific error, 520 Origin Error is always something returned by your origin - something went wrong when processing the request but it’s not something with a specific error code. You should check your server’s error logs for any obvious issues.

So I have to check the something with the siteground host,not with couldflare ,is that all right ? thanks for giving this direction.

I have connected with siteground , they said they have limited the baidu crawler ,so thansk for the answer @Judge

This topic was automatically closed after 31 days. New replies are no longer allowed.