Is there a way to block the egregious crawlers of Similarweb?
Note: I’ve attempted to discern their range of IP addresses, but they seem to change often.
Is there a way to block the egregious crawlers of Similarweb?
Note: I’ve attempted to discern their range of IP addresses, but they seem to change often.
If you can figure out their user agent, then you can block via that.
I’m not sure how to find their user agent, any ideas on that? Or other alternative way
Bot fightmode sadly is the best way. most here are waiting for them to push the ability to whitelist on it on all plans as at the moment enabling it breaks so much its well documented. these pesky bots time is limited hopefully.
This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.