Redirecting robots.txt from subdomains to main

General Rules
1

Hi

We have a main domain a.com

and about 20 subdomains:
b.a.com
c.a.com
d.a.com
…
I have created a redirect list with
b.a.com/robots.txt to a.com/robots.txt
c.a.com/robots.txt to a.com/robots.txt

But for some unknown reason, I only get the redirect to work if the original subdomain has no robots.txt in it, and it doesn’t work for the ones with their separate robots.txt.

Can you please tell me what am I doing wrong here?

Thanks,
Ron.

3

Try purging all relevant caches (Cloudflare and browser) for the robots.txt URLs. It sounds like a cached URL is preventing the redirect to trigger.

4

I have tried, and its now 30 minutes since CF full cache wipe.

I’m trying from incognito from fresh wondows, but cant see the new robots.

i have this in place, but its not working

as opposed to this one that does work

any other suggestions?

5

Is there a DNS record (A, AAAA or CNAME) for the subdomains where it’s not working? And are these records :orange:?

1 Like
6

bingo

thank you very much
it wasnt proxied

2 Likes