Semrush etc. blocking bots

General Rules
1

hello,

The bot fight mode in the security settings is active.

(http.user_agent contains "AhrefsBot") or (http.user_agent contains "SemrushBot") or (http.user_agent contains "BLEXBot") or (http.user_agent contains "DotBot") or (http.user_agent contains "MJ12bot") or (http.user_agent contains "Sogou") or (http.user_agent contains "Moz dotbot") or (http.user_agent contains "prerender") or (http.user_agent contains "Ahrefs Site Audit") or (http.user_agent contains "Botify") or (http.user_agent contains "AddThis") or (http.user_agent contains "Cxense") or (http.user_agent contains "Moz rogerbot") or (http.user_agent contains "DataForSEO") or (http.user_agent contains "SEMrush") or (http.user_agent contains "Revvim")

I also created rules for some custom bots in firewall rules.

but despite doing this, traffic still continues to come from the bots I added above.

How can I permanently block it?

ssssss
ssssss1468Ă—601 119 KB

2

Where are you seeing this traffic - on Cloudflare’s analytics or on your origin server logs? Have you protected your origin server from requests not originating from Cloudflare?

3

@erisa-cf thanks…

There are many of the sites that I constantly mention in the security > event area.

I just got this picture.

123
1231792Ă—753 125 KB

4

You have a separate rule called “bots” (all lowercase) that is allowing through those bots (it’s set to Allow)

I’m guessing the Allow rule is run first and allows the bots through. You can delete that rule or reorder them.

2 Likes
5

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.