Semrush etc. blocking bots

hello,

The bot fight mode in the security settings is active.

(http.user_agent contains "AhrefsBot") or (http.user_agent contains "SemrushBot") or (http.user_agent contains "BLEXBot") or (http.user_agent contains "DotBot") or (http.user_agent contains "MJ12bot") or (http.user_agent contains "Sogou") or (http.user_agent contains "Moz dotbot") or (http.user_agent contains "prerender") or (http.user_agent contains "Ahrefs Site Audit") or (http.user_agent contains "Botify") or (http.user_agent contains "AddThis") or (http.user_agent contains "Cxense") or (http.user_agent contains "Moz rogerbot") or (http.user_agent contains "DataForSEO") or (http.user_agent contains "SEMrush") or (http.user_agent contains "Revvim")

I also created rules for some custom bots in firewall rules.

but despite doing this, traffic still continues to come from the bots I added above.

How can I permanently block it?

Where are you seeing this traffic - on Cloudflare’s analytics or on your origin server logs? Have you protected your origin server from requests not originating from Cloudflare?

@erisa-cf thanks…

There are many of the sites that I constantly mention in the security > event area.

I just got this picture.

You have a separate rule called “bots” (all lowercase) that is allowing through those bots (it’s set to Allow)

I’m guessing the Allow rule is run first and allows the bots through. You can delete that rule or reorder them.

2 Likes

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.