Google ad bot restricted from crawling website

What is the name of the domain?

What is the error message?

Sorry you have been blocked. you are unable to access wasp3d.com

What is the issue you’re encountering

Google ad bot not allowed to crawl pages of website wasp3d.com

What steps have you taken to resolve the issue?

Read the knowledgebase, checked safe bots list. Google ad bot present there. Also updated the latest cloudflare recommended security policies. Bot fight mode is already disabled.

Was the site working with SSL prior to adding it to Cloudflare?

Yes

What is the current SSL/TLS setting?

Full

What are the steps to reproduce the issue?

  1. Open DevTools → More Tools → Network Conditions
  2. Uncheck “Use browser default” under User Agent
  3. Select “Custom…” and enter:
    Mozilla/5.0 (compatible; GoogleAdsBot/2.1; +http://www.google.com/adsbot.html)
  4. Reload the page to simulate the AdsBot view

Yeah, that’s not going to work. This would be flagged as a fake GoogleBot, which it most definitely is.
If you believe that Google AdsBot has been blocked by Cloudflare, check your events log to find out why:

https://dash.cloudflare.com/?to=/:account/:zone/security/events

1 Like

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.