We’re building an application where we crawl websites and their content to analyze.
But we cannot access Cloudflair protection bot websites.
Is there any way we can certify our bot and wishlist it so we can safely crawl protected websites?
We’re building an application where we crawl websites and their content to analyze.
But we cannot access Cloudflair protection bot websites.
Is there any way we can certify our bot and wishlist it so we can safely crawl protected websites?
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.