So I have this issue bypassing Cloudflare to get to a website. I am trying to monitor for changes on a web page with a tool called Huginn. I have had the monitoring working completely for some time. This changed with Cloudflare put up their “Warning: Suspected Phishing Site Ahead!
This link has been flagged as phishing. We suggest you avoid it.” warning page. If you are in a web browser you can simply click a button go in, however, web bots cannot do this.
This site is a know ransomware site, I check it for there victim updates. I am a White Hat Security Researcher with clients affected by this ransomware, so I need to say up to date on the ransomware groups activities.
I am looking for a way to prevent CloudFlares warning from stopping the bot. Maybe there is some header flag, GET, POST, or cookie variable I can set?
Any help would be great.