Domain prefix in robots.txt file

Hi all, I have some sites on the Cloudflare free platform. I don’t use www on these sites just https://siteneame.com. I’ve read that if sites are on Cloudflare then www should be used. Is this true?
Should I also be using www in my robots.txt file? Many Thanks.

Some hosting services require you to use ‘www’ because of a CNAME issue. If non-www works for you, keep using it. Just make sure you have a redirect in place to send www visitors to your non-www site.

Robots files shouldn’t have the domain part of your URL anyhere. Just the path or file itself.

This topic was automatically closed after 14 days. New replies are no longer allowed.