How to block all user agents?

I am trying to block ALL crawlers/search engines from accessing a specific domain.
I have tried going to (Cloudflare dashboard>selected the domain)>Security>WAF>Tools>User Agent Blocking>created a new blocking rule and tried to put * into the ‘User Agent’ box but it won’t allow that… how can I block all search engines from crawling the site? And will this work for a NON-proxied domain (gray, NOT orange cloud) ?

Blocking all user agents will block any clients including browsers from being able to access your page.

No, it requires :orange: DNS record

2 Likes

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.