What is the name of the domain?
What is the issue you’re encountering
when i enable cloudflare googlebot and bingbot not having access to crawl our webpages
What is the current SSL/TLS setting?
Full
when i enable cloudflare googlebot and bingbot not having access to crawl our webpages
Full
From the screenshot above, the meta
tags contain both noindex
and nofollow
.
This seems to be the issue which comes from the Website, web application or a service itself, and not a Cloudflare’s Bot Fight Mode feature.
Did you checked your configuration?
May I ask if you are using free or paid plan type?
Furthermore, checking the website source code view, the meta
robots tag looks good:
Hi,
I am using the Cloudflare Pro version. The meta tags do not contain both noindex
and nofollow
. As per your screenshot, it only shows the index, follow
tag. When I disable Cloudflare, it works fine. I have attached a screenshot from a third-party tool for reference.
Thank you for feedback.
Ou well, then may I ask what error do you get?
Do you see it in the Google Search Console or?
Do you see Googlebot requests being challenged or blocked under the Security tab → Events at Cloudflare dashboard for your zone?
I’d suggest you to double-check the Security → Events at Cloudflare dashboard under your Cloudflare account for your zone, or via direct link https://dash.cloudflare.com/?to=/:account/:zone/security/events.
You should be able to see the challenged or blocked event under the Security tab → Events at Cloudflare dashboard for your zone and know exactly which security option was triggered. Could be Managed Rules my best guess, otherwise Bot Fight Mode or Browser Integrity Check.
Wonder what kind of tool are you using to test?
Again, what do Security Events say? Could you share some details?
The shared screenshot doesn’t look like it’s from Google Search Engine.
Otherwise, did Bing Webmaster Tools changed their interface UI/UX, I might have no clue
This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.