I am going nuts trying to whitelist the Ahrefs crawler on Cloudflare.
I followed these steps
- Add the Ip range of Ahrefs (link here) into the firewall section.
–> Doesn’t work // Here is the error message on ahrefs :
"The HTTP server encountered an internal error (520). The server may currently have issues.
This website is protected by the Cloudflare firewall"
- Tried to add a firewall rule, with the same ip adresses.
–> Still doesn’t work
- Tried to “Pause” cloudflare on the overview page
–> Still same error
Please can someone help me I paid for ahrefs crawl and can’t do it, that’s really annoying.
Thank you for your help