I am checking my crawler status with ahrefs and moz , goolge but it’s showing The HTTP server returned error 406: “Not Acceptable”. This request was likely filtered by a firewall. This website is protected by the Cloudflare firewall.
Kindly tell me how can I fix them.
It’s because you have a firewall rule preventing bots from loading your website. It’s most likely blocked user agent(s)
How can I fix, and allow bot to crawl my site
Would you mind showing me your current firewall rules?
This topic was automatically closed after 30 days. New replies are no longer allowed.