Cloudways Website Cron Job Interupted by Cloudflare

Hi, I have a website hosted with Cloudways that has a cron job that runs a cUrl to a URL on the same website.

I have tested the cron job but the script doesn’t appear to be running.

By running the script manually at the URL I eventually receive a Cloudflare error message. The script will take time to run as it scans every page but it is safe for this script to run.

Our Cloudflare options through Cloudways do not allow me to whitelist IPs and URLs that can run without interuption from Cloudflare.

Are there any other options open to me besides directly setting up my own Cloudflare account?

Many Thanks

My best guess is either Bot Fight Mode or Browser Integrity Check feature challenges or blocks the request :thinking:

You should see the challenged/blocked firewall events in the firewall events if you navigate to the Cloudflare dashboard → Security → Overview and lookup for Firewall events for the past 24hours or so. Once you find them, click on a particular one to find more details about it (user-agent, IP, HTTP version …).

Could you share some details which service was triggered that blocked you?

You could determine if this behaviour continues even by using a “Pause” option at Cloudflare as follows:

  1. Use the “Pause Cloudflare on Site” option from the Overview tab for your domain at dash.cloudflare.com .
  2. The link is in the lower right corner of that page.
  3. Give it five minutes to take effect, then make sure site is working as expected with HTTPS.
  4. Re-try with updating.
  5. Upon success, un-pause and continue using Cloudflare.

If yes, then I’d suggest you to whitelist your Cloudways / origin host / server / hosting IP address by navigating to the Security → WAF → Tools → IP Access Rules with the action “allow” for your Website and try again.

O-oh, that so. Hm :thinking:

Hi fritex,

Thank you for your reply.

It is a script to check all pages within the site for broken links.

We do not have an account with Cloudflare so I don’t think the dashboard options will be an option.

It was set up directly through Cloudways hosting control panel and according to their support team the Cloudflare options cannot be changed.

It is looking like I may have to set up Cloudflare directly so that I have access to the options within the dashboard.