Alexa Bots cannot crawl 403 Error

Security
#1

My site cannot indexed/crawled by alexa for alexa certified purpose. Alexa support team informed this :

It looks like your cloudflare server started returning a “403 Forbidden” error to our crawler and that is why the scans are failing. Please ask your webmaster or IT person to correct the problem with your server so that it does not return an error to the “Alexabot” crawler.

Alexa’s “Alexabot” crawler identifies itself in the User Agent as "Mozilla/5.0 (compatible; Alexabot/1.0; +http://www.alexa.com/help/certifyscan).

Also here are the error details:

403 Forbidden

403 Forbidden

nginx

After I search in firewall log, no alexa bot was blocked.

Any solution on this ?

#2

Solution founded.

Alexabot crawler:

52.86.176.3
52.4.48.181
52.2.182.169
52.86.185.29

add to IP Address whitelist

1 Like
#3

This topic was automatically closed after 30 days. New replies are no longer allowed.