Hello,
we have several subdomains proxied by DNS. Most of the analytics we receive are correct but /cdn-cgi/rum is always the most visited url.
Sometimes we have a crawler or bot checking random urls in our domains and analytics doesn’t show the real url but /cdn-cgi/rum
Then, we must get into our server and check the logs in order to see what happened and the real urls accessed by the bot.
Is there any option to fix this?
Thanks a lot!
This is real user management you can read more on this here:
https://blog.cloudflare.com/tag/browser-insights
You can disallow crawlers going to this in your robots.txt
robots.txt file to include Disallow: /cdn-cgi/ .*Thanks. We had this exclusion in robots.txt just in one of the servers. We added to the others.
I’ve read the information you sent to us but I don’t understand why the real urls were not written in the analytics and we could only find the cdn one.
Could you explain it to me?
Best regards
This endpoint is used for several areas list below, but analytics is one of the main reasons.
When you add a domain to Cloudflare, Cloudflare adds a `/cdn-cgi/` endpoint (`www.example.com/cdn-cgi/`) to that domain.
This endpoint is managed and served by Cloudflare. It cannot be modified or customized.
Thanks a lot.
This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.