Approximately 3 days ago, Cloudflare began blocking Google Shopping fetch of my product feed xml file from my website that is behind the Cloudflare CDN. It was just noticed today in reviewing logs at Google Merchant Center… which was reporting an “authorization error” when the fetch doesn’t require an authorization. Similar circumstances were apparent for Bing. Reviewing the firewall logs at CF, I found the legitimate requests were being blocked as “Fake”… Cloudflare Specials rules 100201 and 100202. The work around is to disable these two rules, which then allowed the bots to fetch normally.
This appears to be a regression of Cloudflare Managed Special rules are blocking Googlebot
This has been documented and reported to CF support on a ticket, but as of this post (about 90 minutes since ticket opened) there has been no reply.
FYI… I’m posting here because it’s possible this is widespread and may be impacting more than just my shopping feed as I’m assuming it would also be blocking ordinary search engine scans as well. As of now there is no mention of the issue in the CF status/incident pages, but could be disastrous for SEO if affecting other websites.