Here is the URL that gives access to the ads.txt file in question: https://driverspedia.org/ads.txt
I have set the security level for the website at the “I’m Under Attack” option, because it’s the only measure that prevents bots from registering and spamming the wiki.
The ads.txt file is accessible through a web browser, after completing the human verification process.
What I suspect is that the Google bot can not pass that step and at the same time Cloudflare has not allowlisted it.
Is there a rule that I should introduce in order to prevent the error?
Just turn off “I’m under attack” mode - it’s not meant for continuous use. You should just set the security level to high for maximum protection when not under direct attack.
Use a WAF rule to challenge just on the wiki registration page to stop those bots.
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.