Website can't be crawled by a 3rd party software with allowed IP addresses

What is the name of the domain?

https://bashmaistora.bg

What is the error message?

Awesome Screenshot - Audit stopped due to website issue: we were unable to reach your website’s homepage. Check how to configure access for our crawlers.

What is the issue you’re encountering

I use a 3rd party SEO software - SerpStat for domain health check and it can’t crawl the websites because Cloudflare blocks their crawlers. We allowed their IPs to make it work but it didn’t.

What steps have you taken to resolve the issue?

Allowed IPs of the 3rd party crawlers in Cloudflare

What are the steps to reproduce the issue?

You can’t as you need to be logged into the 3rd party software

Ensure all their IPs are allowed: https://serpstatbot.com/serpstatbot-ip.txt

If you’re already allowing all their IPs, then check your Cloudflare Security Events to find exactly what’s triggering the blocking and tweak your WAF rule(s) accordingly.

Thanks a lot George I’ll forward your suggestion to the developer and let you know if it worked.

This topic was automatically closed after 15 days. New replies are no longer allowed.