What is the name of the domain?
A universal collection of online calculators for simple calculations and conversions. Explore online calculators in math, fitness, finance, science, and more.
What is the issue you’re encountering
I’m unable to access robots.txt using browser. Tried multiple browsers and also in incognito mode.
Google Search console is also showing a crawl error on robots.txt
The robots.txt file is present in the root directory.
Surprisingly it can be accessed by visiting: https://calcbun.pages.dev/robots.txt
But not by accessing https://calcbun.com/robots.txt
How to fix this issue? Is it a configuration issue?
arun
August 1, 2024, 5:48pm
2
https://calcbun.com/robots.txt
It seems to load okay at my end:
Are you still seeing the issue?
1 Like
This is weird. I tried from different browsers and devices. Still not showing.
Even Ahrefs is reporting a missing robots.txt issue!
What can be the issue?
I’m getting an error as too many redirects !
arun
August 1, 2024, 6:40pm
4
Seems to be okay on Ahrefs too:
AhrefsBot powers the database for both Ahrefs, an online data toolset, and Yep, a revenue-sharing web search engine.
About it not loading as expected on your devices, could you try clearing browser caches ?
system
Closed
August 16, 2024, 5:32pm
5
This topic was automatically closed after 15 days. New replies are no longer allowed.