Can we set header in HTTP redirect response?


#1

Hi,

Would be possible to add x-robots header at HTTP 301 response?

Requested http://example.com/page
Redirecting to: https://www.example.com/page/

SERVER RESPONSE: HTTP/1.1 301 Moved Permanently
Date:  Mon, 17 Jul 2017 06:21:31 GMT
Connection: keep-alive
Cache-Control: max-age=3600
Expires: Mon, 17 Jul 2017 07:21:31 GMT
Location:  https://www.example.com/page/
X-Content-Type-Options:  nosniff
Server:   cloudflare-nginx
CF-RAY:  xxxxxxxxx-SJC

I have added x-robots tag in final response, but it seems missing in 301. I want to include it.

Thanks & Regards,
Gulshan


#2

Per my understanding, search engine won’t index a 301 redirection and will ignore the X-Robots-Tag as they would consider the HTTP Status Code first.

So you won’t need the headers on a 301.


#3

I have problem with another SE, which index even 301.


#4

That is strange, could you relocate this post to the Product Requests topic so that others can easily see this post and give further comments.

Also, you can request removals from the search engines. Through either Google Webmasters, Bing Webmasters or Yandex Webmasters.


#5

Thanks for your concern.

I manage to get in touch with official webmasters team of SE. Tried all those things what they suggested. Yet no solution expect waiting :frowning:

So personally I want to try this time by adding noindex for that specific bot in HTTP 301 response.


#6

Learned about a big issue. Reporting privately to CF team.