Is it possible to block all countries except 1 but allow google, fb, bing bots, etc… to crawl?
I know I can use “Known bots” in firewall, but that for some reason doesn’t work for google shopping bot or facebook catalog bot.
Open a Support Ticket. Maybe they can add those two bots to Known Bots.
Or add firewall exceptions for those bots’ User Agent Strings…or maybe even better would be Google’s and Facebook’s ASNs. (AS15169 and AS32934).
This topic was automatically closed after 14 days. New replies are no longer allowed.