Hi all:
I‘m a chinese free plan Cloudflare user , and the site host is siteground , we use Cloudflare for the cdn.The google and bing crawler works well ,but baidu crawler nothing works. from the baidu official crawler test tool i got the 520 error. and the detail description shows as below:
HTTP/1.1 520 Origin Error
Date: Mon, 27 Apr 2020 08:31:34 GMT
Content-Type: text/html
Transfer-Encoding: chunked
Connection: close
Set-Cookie: __cfduid=da9ab568bce026160d80ef1257e091b091587976293; expires=Wed, 27-May-20 08:31:33 GMT; path=/; domain=[mysite domain]; HttpOnly; SameSite=Lax
Cache-Control: no-store, no-cache
Expect-CT: max-age=604800, report-uri=“https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct”
Server: Cloudflare
CF-RAY: 58a730195ba005a2-LAX
cf-request-id: 025c5c63db000005a2d3809200000001
pc agent and mobile agent all went wrong,also the sitemaps we sent to baidu still cralws failed . i didn’t set any firewall option . is there something wrong with my site setting or Cloudflare cdn do not support baidu crawler ?
this is my site address:
My site address
thanks for helping me!