GoogleBot blocked

My site (www.raptorresource.org) is configured through Cloudflare to allow known bots through, but when I changed my user agent to GoogleBot via Chrome Developer Tools, it challenged me.

The Cloudflare challenge is preventing me from running Google Ads that point to urls on my website. How do I allow the GoogleBot through? I’m on the Business Pro package.

That’s expected. The request didn’t come from a Googlebot IP/ASN so it was assumed (correctly) it wasn’t really the Googlebot. It would be trivial to bypass rules if they just relied on the user agent.

If the real Googlebot can’t actually access your site, take a look in your security events log which will tell you why it was blocked/challenged and then you can configure the WAF with exceptions or to skip rules/features to allow it.
https://dash.cloudflare.com/?to=/:account/security/events

3 Likes

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.