Alexa Bots cannot crawl 403 Error

My site cannot indexed/crawled by alexa for alexa certified purpose. Alexa support team informed this :

It looks like your cloudflare server started returning a “403 Forbidden” error to our crawler and that is why the scans are failing. Please ask your webmaster or IT person to correct the problem with your server so that it does not return an error to the “Alexabot” crawler.

Alexa’s “Alexabot” crawler identifies itself in the User Agent as "Mozilla/5.0 (compatible; Alexabot/1.0; +http://www.alexa.com/help/certifyscan).

Also here are the error details:

403 Forbidden

403 Forbidden


nginx

After I search in firewall log, no alexa bot was blocked.

Any solution on this ?

Solution founded.

Alexabot crawler:

52.86.176.3
52.4.48.181
52.2.182.169
52.86.185.29

add to IP Address whitelist

1 Like

This topic was automatically closed after 30 days. New replies are no longer allowed.