I’d like to expose the subscriber only content to the Google Bot.
I’d therefore like to be able to determine if the client is indeed the Google Bot or not, in order to grant or not to grant access.
Currently Cloudflare provides the possibility in a firewall to tell if the Bot is a known good bot (cf.client.bot); how can I use this information in my application?
Is there a HTTP header where this information is stored (i.e.: the real client IP is in the CF-Connecting-IP header)?
A workaround would probably be to block all request with “Googlebot” in it which are not a “good known bot” and enable the subscriber only content for all resulting user agents with “Googlebot” but I don’t really like that solution. Any ideas?