How to set the crawler to automatically return to the source IP

How to set up a crawler to automatically return to the source IP and allow users to use the CDN line? I don’t want search engines to use CF as well, but I haven’t found the relevant settings. Is it the default crawler to return to the source?

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.