Known bots are the good bots , right ? I should not block them ?
“Good” is subjective. But they’re not bad. More like well-behaved. I don’t like all of them, so I do block some of them.
Perfect answer above. I too block some bots - mainly some SEO bots that I have not requested to crawl my domain and have no interest in spending resources for them (even less if I was not the person who requested to have the domain crawled)…
They may be “known” but are of no direct benefit to my business.
This topic was automatically closed after 30 days. New replies are no longer allowed.