Error 404 google search bot

General Rules
1

there are 4 rules:

  1. (cf.client.bot) or (ip.geoip.asnum eq 13236 and ip.geoip.asnum eq 13238 and ip.geoip.asnum eq 208722 and ip.src eq 83.220.174.189) - Spip
  2. (ip.geoip.asnum in {35048 24940}) or (ip.src in {95.191.162.50 89.223.104.178 79.140.16.20}) or (http.host in {“site1” “site2” “site3”}) - Block
  3. (ip.src in {::/0} and not ip.geoip.asnum in {13238}) or (not ssl and not ip.geoip.asnum in {13238}) or (http.request.uri.path contains “/favicon.ico”) - Managed Challenge
  4. (not http.request.version in {“HTTP/2” “HTTP/3” “SPDY/3.1”}) or (http.referer eq “”) or (http.request.uri contains “utm”) - Managed Challenge

everything was working great until today. I am adding a new page to the search console index and getting a 403 error. I turn off rule 4 and everything is fine 200 ok. The rules have stopped working. Why doesn’t rule 1 work? Next, I added ASN google 15169 to 1 rule, but nothing helped. I also added user agent Google-InspectionTool/1.0 and nothing. Only disabling the 4th rule solves the 403 issue.

1 Like
4

Here is a screenshot of a bot from Google that falls into the 4th rule

1
11190×495 22.1 KB

5

(ip.geoip.asnum eq 13236 and ip.geoip.asnum eq 13238 and ip.geoip.asnum eq 208722 and ip.src eq 83.220.174.189)

ip.geoip.asnum cant be equal to all three values at once “and” needs to be “or”

Simple GoogleBot rule is ASN = 15169, and IP NOT IN list of googles published GoogleBot IP addresses then Block

2 Likes
6

Thank you! Solved the problem.

7

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.