What WAF settings do I need to allow Google to crawl my website while maintaining rules to prevent scrapers? Current settings are causing 403 errors in search console. What I have isn’t working: Field: user agent Operator: equals Value: Googlebot Does this seem correct? I thought there was an…

You’re welcome. Using URI Full with equals operator is rarely the best option. When you use a URI field in the Expression it gives you an example of what that field would be matching against. Here you see examples for the URI Full field: [image] That means a URI Full match (using URI Full with…

Allow Google bot with rules

Website, Application, Performance Security

system Closed May 5, 2023, 3:28pm 19

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.

Website-link-preview-not-working

Need to allow known bots and preview URL page for website

Topic		Replies	Views
403 Status code with country restriction Security	2	707	December 18, 2023
WAF rules and 403 forbidden Google bot General	5	1862	May 6, 2023
Custom rules googlebot not able to crawl website General	4	455	March 30, 2024
DDoS Attack and WAF rules set up Security	3	920	March 15, 2024
What are best settings so that google products (bots/crawlers) dont get blocked) Security	2	1271	May 31, 2023

Allow Google bot with rules

Related topics