Facebook/WhatsApp crawler (facebookexternalhit) blocked by Cloudflare when trying t

For Workes & Pages, what is the name of the domain?

dooiu.com

What is the error number?

Ray ID: 8eb75a593b3c4584

What is the issue or error you’re encountering

“Sorry, you have been blocked” Facebook’s crawler (facebookexternalhit) is being blocked by Cloudflare when trying to generate link previews for WhatsApp/Facebook sharing. The crawler is attempting to access our CodeSandbox staging frontend to read Open Graph meta tags, but gets blocked by Cloudflare security. Crawler IP showing in logs: 2a03:2880:24ff:e::face:b00c

What steps have you taken to resolve the issue?

Created a WAF rule to allow social media crawlers:

Copy(http.user_agent contains “facebookexternalhit” or
http.user_agent contains “WhatsApp” or
http.user_agent contains “LinkedInBot” or
http.user_agent contains “Twitterbot”)

Modified our Worker to serve proper HTML with meta tags
Set WAF rule to “Skip all remaining rules” and placed it first
Added proper CORS and content-type headers in Worker responses

Need help configuring Cloudflare to allow Facebook’s crawler to reach our Worker so it can serve the meta tags needed for link previews.

What are the steps to reproduce the issue?

We have a Cloudflare Worker that generates and handles invitation links
When sharing these Worker-generated links in WhatsApp or Facebook:

URL pattern: https://{worker-domain}/join/{token}
Example (with redacted domain): https://xxx.xxx/join/abc123

Test using Facebook’s Sharing Debugger (Sharing Debugger - Meta for Developers):

Paste Worker-generated link
Facebook’s crawler (facebookexternalhit) attempts to access the URL
Instead of getting our Worker’s HTML response with meta tags
Receives Cloudflare block page with Ray ID: 8eb75a593b3c4584

What is the name of the domain?

dooiu.com

What is the issue you’re encountering

Facebook/WhatsApp crawler (facebookexternalhit) blocked by Cloudflare when trying to scrape meta tags for link previews

What steps have you taken to resolve the issue?

Key Details:

Crawler IP: 2a03:2880:24ff:e::face:b00c (Facebook’s crawler)
Error: “Sorry, you have been blocked”
Ray ID: 8eb75a593b3c4584
Accessing: csb.app domain
Purpose: Need crawler access to generate link previews for social sharing

Request: Need to allow Facebook’s crawler (facebookexternalhit) to access the site to read Open Graph meta tags for generating link previews in WhatsApp and Facebook.
Solution Attempted:

Created WAF rule to allow social media crawlers
Added robots.txt allowances
Both still result in blocks

What is the current SSL/TLS setting?

Off

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.