Sitemap http header shows X-Robots-Tag, Google Search Console cannot index

Answer these questions to help the Community help you with Security questions.

What is the domain name?

Have you searched for an answer?

yes

Please share your search results url:

C’mon…

When you tested your domain, what were the results?

Describe the issue you are having:

Issue with a Wordpress site. X-Robots-Tag = noindex on sitemap. Wondering if Cloudflare could be causing this?

What error message or number are you receiving?

What steps have you taken to resolve the issue?

Searched everywhere to find solutions within Wordpress. Have not found a solution yet.

Was the site working with SSL prior to adding it to Cloudflare?

What are the steps to reproduce the error:

Use https://httpstatus.io/ to search https://www.oneoption.com/sitemap_index.xml

Have you tried from another browser and/or incognito mode?

Please attach a screenshot of the error:

Hi,

The X-Robots-Tag: noindex is not being added by Cloudflare, but most likely by WordPress itself or your SEO plugin.

Regardless, that’s not the reason why Google is not reading your sitemap.

The noindex directive correctly prevents Google from returning your sitemap in search results, but does not prevent Google from crawling your website.

You need to check in your Cloudflare Dashboard > Security > Events for logs re: the sitemap path, to see if any Cloudflare feature, such as Bot Fight Mode, may be blocking Google crawler. If you don’t find any pertinent event, in all likelihood Google crawler is being blocked by your origin.

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.