We need to disable caching by user-agent to support an enterprise search engine that accesses gated content using a custom user-agent. It appears from reading the caching documentation that we can’t use rules to turn off caching by user-agent. Has anyone else tried this and found a way to do this, perhaps through workers or through using a custom subdomain and firewall rules?
Not that i am aware of.
But workers are magic ^^
Does the crawler accept cookies? If yes you could try a Page rule and Set ‘bypass cache on cookie’
This topic was automatically closed after 14 days. New replies are no longer allowed.