List of Good and Bad Bots for WAF

Hello friends how are you ?

I want to protect my own website from DMCA and similar malicious bots.

I added it for WAF

(http.user_agent contains “Yandex”) or (http.user_agent contains “muckrack”) or (http.user_agent contains “Qwantify”) or (http.user_agent contains “Sogou”) or (http.user_agent contains “BUbiNG”) or (http.user_agent contains “knowledge”) or (http.user_agent contains “CFNetwork”) or (http.user_agent contains “Scrapy”) or (http.user_agent contains “SemrushBot”) or (http.user_agent contains “AhrefsBot”) or (http.user_agent contains “Baiduspider”) or (http.user_agent contains “python-requests”) or (http.user_agent contains “crawl” and not cf.client.bot) or (http.user_agent contains “Crawl” and not cf .client.bot) or (http.user_agent contains “bot” and not http.user_agent contains “bingbot” and not http.user_agent contains “Google” and not http.user_agent contains “Twitter” and not cf.client.bot) or (http.user_agent contains “Bot” and not http.user_agent contains “Google” and not cf.client.bot) or (http.user_agent contains “Spider” and not cf.client.bot) or (http.user_agent contains “spider” " and not cf.client.bot)

However, when I check the WAF, I see that Google bot is blocked.

I need code to block all bad bots (including DMCA bot) and allow good bots, can anyone help?

My site is not Wordpress, I just need to block bots

Pleas help me

I couldn’t find a solution yet

Is there anyone who can help?

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.