Cloudflare blocking Ahrefs bots/IPs from crawling my site for a site audit?

General
1

Basically what the title says. I cannot get Ahrefs to crawl my site for their SEO audit. This is the error that is returned to me on their site:
“The HTTP server returned error 403: “Forbidden”. This request was likely filtered by server configuration. This website is protected by the Cloudflare firewall”

I talked with their support and they confirmed Cloudflare was blocking their bots. I whitelisted their IP range in the firewall settings along with allowing their user agents, but I still get the 403 error from Ahrefs.

Any idea what’s going on here and how it can be fixed?

2

Can you please post a screenshot of your firewall rules?

3

Hi there,

I’m having the same problem.

Here’s the IP ranges the Ahref bot uses: https://help.ahrefs.com/getting-started-with-ahrefs/ahrefs-explained/what-is-the-list-of-your-ip-ranges

And here’s my current firewall rule: https://imgur.com/a/XSgyGA3

Can someone help me?

Thanks and regards,
Luca

4

That won’t work since their IP ranges are in a CIDR format. The following should work:

(ip.src in {54.36.148.0/24 54.36.149.0/24 54.36.150.0/24 195.154.122.0/24 195.154.123.0/24 195.154.126.0/24 195.154.127.0/24})

But I think it would be better to create an IP access rule instead of wasting one of your firewall rules. You should be able to create 7 rules in total to whitelist all 7 of their IP ranges.

2 Likes
5

Thanks, Judge! Appreciate your fast response.

Just tried to run another crawl and still get the same error (403). Do you have any other ideas on how I could try to fix this?

6

This topic was automatically closed after 14 days. New replies are no longer allowed.