Bot Fight Mode blocking Pinterest

[jim37]

I’ve got IP 54.236.1.37 from Pinterest being blocked by Ruleset Name Bot Fight Mode for Definite Bots

From their definition that IP passes -

Pinterest crawler

host 54.236.1.37
37.1.236.54.in-addr.arpa domain name pointer crawl-54-236-1-37.pinterest.com.

I set up a firewall rule to allow everything access to the product feed file it’s trying to fetch. The firewall log shows it both being allowed and it being blocked

16 Jul, 2021 01:26:16 Allow United States 54.236.1.37 Firewall rules
16 Jul, 2021 01:26:16 Block United States 54.236.1.37 Firewall: Managed

And I’m still getting an error from Pinterest

Your catalog could not be uploaded because we couldn’t process
Your data source can’t be accessed

Is there either a way to set up a rule that allows it to access the XML file? Or can the Bot Fight Mode be updated to allow it?

[sdayman]

@jim37

From their definition that IP passes

You mean it counts as a definite bot? I agree. Unfortunately, there are no bypasses for Definite Bots.

[jim37]

It should be classified as a “Verified bot”

Verified bots are unique good bot identities validated by Cloudflare. Select an action for verified bots for this traffic.

[sdayman]

Pinterest is on the FAQ list, but “Definite Bots” is extremely unforgiving. Do you have Verified Bots enabled?

Still, though, the Allow should have let it through and be done with it. Maybe @mdemoura has some insight into what happened.

[jim37]

Yes -

[jim37]

[jim37]

Still no update on this? Pinterest still can’t pick up my catalog feed

[cs-cf]

Thanks for the report; we’ve updated our logic and a fix should be out shortly if it isn’t already.

[jim37]

Thank you