Googe feed fetcher being blocked when is is allowed

Hello

For some reason, even though I have good feedfetcher set “if not” and all other “if not” are working just fine. C/F keeo blocking it according to logs. And stopping my google news instant indexing

This rules seems to be working. It is stopping the bots I dont want, But I set it to allow feedfetcher from google. But it still gets blocked.

I have tried so much in the rule. C/F just keeps blocking it when told not too

(http.request.uri.path eq “/feed”) or (http.request.uri.path eq “/feed/”) or (http.request.uri.path eq “/feed/gn”) or (http.request.uri.path eq “/feed/gn/” and not http.user_agent contains “Googlebot” and not http.user_agent contains “Bingbot” and not http.user_agent contains “googlebot-news” and http.user_agent ne “Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)” and http.user_agent ne “Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36” and http.user_agent ne “Googlebot/2.1 (+http://www.google.com/bot.html)” and http.user_agent ne “Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)” and not http.user_agent contains “Mediapartners-Google” and http.user_agent ne “FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)” and http.user_agent ne “Mozilla/5.0 (Linux; Android 11; Pixel 2; DuplexWeb-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.193 Mobile Safari/537.36” and http.user_agent ne “Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.75 Safari/537.36 Google Favicon” and http.user_agent ne “Mozilla/5.0 (X11; Linux x86_64; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36” and http.user_agent ne “Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Mobile Safari/537.36” and http.user_agent ne “Mozilla/5.0 (compatible; Google-Site-Verification/1.0)” and http.user_agent ne “APIs-Google (+https://developers.google.com/webmasters/APIs-Google.html)” and ip.src ne 85.187.128.60 and ip.geoip.asnum ne 15169 and http.user_agent ne “Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)” and http.user_agent ne “Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36” and http.user_agent ne “Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)” and http.user_agent ne “Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)” and http.user_agent ne “Mozilla/5.0 (compatible; Google-Apps-Script)” and http.user_agent ne “Mozilla/5.0 (compatible; Google-Apps-Script)” and http.user_agent ne " FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)")

As you can see - feedfeature is “Does not equal”

But its getting blocked

As you will. I even put in the block rule "does not equal’ googles ASN. And google feedfetcher still gets blocked. But the rule is obeying all other instructions

I have tried many many things now.

I feel safe to confirm. Googlefeetcher is not in the known bots lists

Doing -

Path /feed
Known bots

With this rule, I am still seeing ge
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html getting blocked

This is even more crazy, I have Googles ASN in my IP access whitelist. And it is still getting blocked if I try restict my /feed url in any way of form

So.

I have just worked out .

If you are going to block your feeds, and you are only allowing known bots. You “Must” also add FeedFetcher-Google; (+http://www.google.com/feedfetcher.html in manually. If you don’t It will get blocked.

I would have thought that FeedFetcher-Google; (+http://www.google.com/feedfetcher.html would be in the trusted known bot. But from all my testing. It’s not. So if you don’t add that manaully. It will get blocked

Oh. And just putting in " If does not equal" will not work in order to allow feedfetcher in. it will only work if using " if does not contain"