We have a main domain
and about 20 subdomains:
I have created a redirect list with
b.a.com/robots.txt to a.com/robots.txt
c.a.com/robots.txt to a.com/robots.txt
But for some unknown reason, I only get the redirect to work if the original subdomain has no robots.txt in it, and it doesn’t work for the ones with their separate robots.txt.
Can you please tell me what am I doing wrong here?
Try purging all relevant caches (Cloudflare and browser) for the robots.txt URLs. It sounds like a cached URL is preventing the redirect to trigger.
I have tried, and its now 30 minutes since CF full cache wipe.
I’m trying from incognito from fresh wondows, but cant see the new robots.
i have this in place, but its not working
as opposed to this one that does work
any other suggestions?
Is there a DNS record (A, AAAA or CNAME) for the subdomains where it’s not working? And are these records ?
thank you very much
it wasnt proxied