Getting hammered by some bot

Website, Application, Performance Getting Started
1

What is the name of the domain?

headphones-pohs.com

What is the isssue you’re encountering

we are getting hammered by some bot

What steps have you taken to resolve the issue?

we are getting hammered by some bot, from:“user-agent”: “Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; [email protected])”, has anyone come across this bot before and how can we block it in robots.txt? the problem its causing is that its on a worker so creating 000,000’s of “requests” a day. I have managed to “block” it out with a “worker route” but this doesnt seem to be the route way to “block/stop” it proprely as we might actually need to use the file path its hammering in the future. A robots.txt seems it might be the right way as long as it obeye robots.txt i guess?

2
3

I dont have a WAF firewall plan, any other way?

4

You can create up to five custom WAF rules on the Free Plan, so I don’t see how you could be without that option, unless you already have used all five of your available rules.

1 Like
5

This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.