Googlebot being blocked by WAF with a 429 response and get GSC get problem

Website, Application, Performance Security
1

What is the name of the domain?

What is the error number?

429

What is the error message?

Block by Rate limiting rules

What is the issue you’re encountering

Googlebot is sometimes blocked by WAF with a 429 response.

What steps have you taken to resolve the issue?

  1. Created a custom rule to skip all components when the ASN or User-Agent includes “Googlebot”.
  2. Verified that no rate limiting rules are applied.
  3. Added an IP Access Rule to allow Googlebot’s IP addresses.

Was the site working with SSL prior to adding it to Cloudflare?

Yes

What is the current SSL/TLS setting?

Off

What are the steps to reproduce the issue?

Filter the Security Analytics view to show entries where the User-Agent includes “Googlebot” and the Edge Status is 429.

2

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.