Edit robots file

Answer these questions to help the Community help you with Security questions.

What is the domain name?

Have you searched for an answer?

Please share your search results url:

When you tested your domain, what were the results?
User-agent: * Disallow: /

Describe the issue you are having:
I cannot find where this record is located, it is preventing google from crawling my site

What error message or number are you receiving?

What steps have you taken to resolve the issue?

  1. I have amended a robots.txt file in my WP site (Yoast plug in)
  2. Google reports the disallow: / ‘robots.txt’ file

Was the site working with SSL prior to adding it to Cloudflare?
The site was working prior to migrating to cloudflare

What are the steps to reproduce the error:

Have you tried from another browser and/or incognito mode?


Please attach a screenshot of the error:
User-agent: * Disallow: /

You skipped probably the most important part.

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.