Disable Caching by UserAgent for Enterprise Search Crawler

We need to disable caching by user-agent to support an enterprise search engine that accesses gated content using a custom user-agent. It appears from reading the caching documentation that we can’t use rules to turn off caching by user-agent. Has anyone else tried this and found a way to do this, perhaps through workers or through using a custom subdomain and firewall rules?

Not that i am aware of.
But workers are magic ^^

Does the crawler accept cookies? If yes you could try a Page rule and Set ‘bypass cache on cookie’

This topic was automatically closed after 14 days. New replies are no longer allowed.