With cloudflare enabled Bingbot is able to see the links in a php include and is crawling them. The only way Bingbot would be able to see those is if he is now getting php code from Cloudflare that isn’t executed.
What steps have you taken to resolve the issue?
Tried not allowing Cloudflare cache the whole site. Tried turning off Bot fight mode and turning off everything bot fight related. Tried allowing all Cloudflare ip addresses in origin firewall, Tried adding a rule that never cache’s php files. No matter what, with it running behind Cloudflare Bingbot starts crawling php include inks. You would only see those if Cloudflare is showing Bingbot code that hasn’t been executed.
PHP code can only be executed on and by your server running the PHP engine.
If Cloudflare is indeed seeing and “getting” your PHP code, that means your server isn’t executing the PHP code to begin with, as it should. If your server is indeed returning unexecuted PHP code as plain text to Cloudflare and Bing, that should be the problem you need to solve.
It’s more likely the root of the problem is not as you described at all.
Thank you for the input George. I am logging the includes, nothing is asking for them files except the server. Those bots instantly stop crawling my php include links as soon as I pause Cloudflare. I have never seen them crawling those things ever before I tried running the site through Cloudflare. Leads me to wonder if I have a Cloudflare setting wrong somewhere…