Detection of bots

Hello, I have huge amount of incoming bots, AWStats classifies them under “Unknown robot (identified by ‘bot’ followed by a space or one of the following characters _+:,.;/-)”. Is cloudflare capable of blocking them? Because I have already enabled cloudflare, but the traffic seem did not have stopped.

Kind regards

The following expression in a firewall rule should apply to your description

(http.user_agent contains "bot_") or (http.user_agent contains "bot+") or (http.user_agent contains "bot:") or (http.user_agent contains "bot,") or (http.user_agent contains "bot.") or (http.user_agent contains "bot;") or (http.user_agent contains "bot/") or (http.user_agent contains "bot-") or (http.user_agent contains "bot)")

If case insensitivity is important you could also wrap all the http.user_agents in a lower() call -> lower(http.user_agent)

1 Like