Bots getting 301 and 302 redirects?

Hi,

We’ve noticed a dramatic decrease in Googlebots crawl rate on our site and wondering if it could be something to do with cloudflare.

In our server logs there are lots of 301 and 302 redirects for googlebot, bingbot and yandex bots.

Could these be getting blocked by some cloudflare settings?

I just have the default Magento rules running and a couple of performance related ones.

Thanks

I’m not sure how Cloudflare could cause 301 and 302 redirects in your server logs. That implies that something on your server is doing the redirect.

Thanks,

This is the first time Ive used a CDN so not familiar with exactly how they work but it does make sense that the servers doing it if its in the server logs.

I was reading this thread and thought it could be a similar issue but like you say it sounds like its at the server end rather than the CDN:

This topic was automatically closed after 30 days. New replies are no longer allowed.