I am still getting the 403 error when I test. Preview is still not showing in WhatsApp.
I do see the image showing in the debugger now, in spite of the 403. I am presuming that the image was retrieved on one of the previous, successful calls like the one you have showed here.
Why would I be getting 403 when you are getting 200? Is it possible that the request by the Facebook bots is sometimes using another id than the ones I have allowed?
No, I have not made any changes to my robots.txt so that is strange.
Where did you see the error that it was blocked by robots.txt? And when you say you cleared it from “their” cache, do you mean Facebooks? How did you do that?
Right below the response code, it said the reason for the 403 “may” have been a robots.txt setting. It was obviously not blocked, as the image did appear on the debug site.
On the same page, at the top, there is the “batch invalidator”. I used that.
I am getting another strange behaviour now. It may not be related to Cloudflare, but it might.
Now that I am getting a preview image, I got a request to change the image, and even though I am re-scraping in the Facebook debugger, and the debugger is picking up the new image, when I actually share the link I am getting the old image.
Do I need to clear a cache in Cloudflare somewhere?