Hi, I’m having an issue where the AHREFs robot is receiving a 403 error even though Cloudflare has been disabled and I have allowlisted their IP ranges and IPs.
Any help is appreciated!
I have a CURL command to reference below:
GET / HTTP/1.1
Host: redacted
User-Agent: Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)
Accept: /
- schannel: remote party requests renegotiation
- schannel: renegotiating SSL/TLS connection
- schannel: SSL/TLS connection renegotiated
- schannel: remote party requests renegotiation
- schannel: renegotiating SSL/TLS connection
- schannel: SSL/TLS connection renegotiated
< HTTP/1.1 403 Forbidden
< Server: nginx
< Date: Tue, 23 May 2023 20:08:51 GMT
< Content-Type: text/html
< Content-Length: 146
< Connection: keep-alive
<
403 Forbidden
nginx