How to Exclude Folders If "Crawl Hints" is on?

How do I exclude folders in “Crawl Hints” because when I turn it on, on Bing Webmaster IndexNow, wp-admin folders, and others are crawled.

You can’t exclude directories from Crawler Hints afaik, but I’m pretty sure Bing will still follow your robots.txt.

As an alternative to robots.txt you can also use the X-Robots-Tag HTTP header and/or a meta name=“robots” tag in the HTML

I normally prefer to use the HTTP header as first choice, HTML meta tag as second choice, and robots.txt as last choice

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.