So I am forcing “www” before it even hits my server and needed htaccess redirects.
BUT - I need to skip this rule if google wants to access my sitemap.xml or ads.txt directly at the https://NO WWW – Then I need it to default back to Cloudflare caching default without redirect.
How do I cancel out that page rule for ANY xml file or txt file anywhere on the site — but still server them through the standard Cloudflare caching?
I have multiple sitemaps in multiple directories - I could really do with a wildcard way of allowing all xml and txt files on the site to not be 301 redirected.
Google treats www and naked domain, as well as their HTTP and HTTPS versions, as different websites. If Google is allowed to crawl the sitemap.xml in the naked domain, that will not help with indexing the www version of it. Not sure about ads.txt, but I’d assume the same mindset prevails.
If you want to improve TTFB, you need a page rule that Caches Everything (including html, bypassing your server). You can then realize TTFB under 20ms.
Like @cbrandt pointed out, you should only use one version of your site. Either with, or without, www.