Content Scraping

I’ve found page https://www.cloudflare.com/security/malicious-bot-abuse/
Different scrapers grab our content.
I’m looking for a solution to block simple curl-based php grabbers using proxies to scrap our text.
I couldn’t find inside the cabinet where to activate this thing and what do I need to do.
Will it work by testing from a typical curl-request?

You can block these with one of the rules from the Firewall section. Either firewall, user-agent or access rule.

As it was written on the page, I supposed to find a solution blocking simple curl-requests from any IP adress automaticly, not with manual adding some rules.

If you dont want to configure anything manually you should try setting your security level to High.

1 Like

This topic was automatically closed after 31 days. New replies are no longer allowed.