YandxBot crawler gets 403 error while accessing my website

What is the name of the domain?

What is the error number?

403

What is the error message?

Sorry, you have been blocked. This website is using a security service to protect itself from online attacks. The action you just performed triggered the security solution. There are several actions that could trigger this block including submitting a certain word or phrase, a SQL command or malformed data.

What is the issue you’re encountering

YandxBot crawler gets 403 error while accessing my website www.junctionbot.io.

What steps have you taken to resolve the issue?

  1. I’ve created a custom rule for YandexBot with a Skip action.
  2. I’ve added the whole Russian Federation zone to exclusions.

What are the steps to reproduce the issue?

You can see it in Yandex Webmaster console (need to be logged it):

Screenshot of the error

I’m using a Trace feature and see that this traffic matches my Skip rule but still gets 403 in the end.

I’d suggest you to double-check the Security → Events at Cloudflare dashboard under your Cloudflare account for your zone, or via direct link https://dash.cloudflare.com/?to=/:account/:zone/security/events.

You should be able to see the challenged or blocked event under the Security tab → Events at Cloudflare dashboard for your zone and know exactly which security option was triggered.

Once you find them, click on a particular one to find more details about it (user-agent, IP, HTTP version …). If yes, could you share some details which service was triggered that blocked you?

This topic was automatically closed after 15 days. New replies are no longer allowed.