Unable to allow IP from Umbrella bot

I have a number of sites on my Cloudflare account and have recently started using a plugin called Umbrella, to manage all WP sites from one dashboard. It’s working fine for most of the sites, however 3 sites are unable to connect. There seems to be an issue with the firewall rules, but they are all the same across the sites (as far as I know) and we’ve already whitelisted their IP, to no avail. Earlier today I paused CF on one of the sites and Umbrella was able to connect. So it’s most likely something to do with CF, I just can’t understand what I’m missing. The domain we’re trying this out on is mcgovernbuilders.ie.

Where did you do this? If it was in WAF → Tools, that should do it.

Without seeing your entire Bad Bots & User Agents rule, it’s difficult to see why that request was blocked.

Yes, in WAF > Tools. But yesterday I received this in an email from Umbrella’s CEO/Founder:

“To monitor your websites uptime and performance, we use external servers all over the world. We have some in Europe, others in Asia and America. These external monitors have dynamic IP adresses and allow us to alert you if your website is down. If you have the possibility to white list our user agent (WPUmbrella), this would help us with the uptime/performance monitoring feature.”

So - is it possible to whitelist a user agent, as suggested above and how would I do that?

(http.user_agent contains “?%00”) or
(http.user_agent contains “/bin/”) or
(lower(http.user_agent) contains “curl”) or
(http.user_agent contains "echo ") or
(http.user_agent contains “eval(”) or
(http.user_agent contains "wget ") or
(http.user_agent contains “AhrefsBot”) or
(http.user_agent contains “ALittle”) or
(http.user_agent contains “baidu”) or
(http.user_agent contains “coccocbot”) or
(http.user_agent contains “DavClnt”) or
(http.user_agent contains “DnyzBot”) or
(http.user_agent contains “DotBot”) or
(http.user_agent contains “GRequest”) or
(http.user_agent contains “Hello”) or
(http.user_agent contains “http-client”) or
(http.user_agent contains “nowledge”) or
(http.user_agent contains “Lua”) or
(http.user_agent contains “mail.ru”) or
(http.user_agent contains “My User Agent”) or
(http.user_agent contains “NetSystemsResearch”) or
(http.user_agent contains “Nikto”) or
(http.user_agent contains “Nimbostratus”) or
(http.user_agent contains “PetalBot”) or
(lower(http.user_agent) contains “python”) or
(http.user_agent contains “ReactorNetty”) or
(http.user_agent contains “RestSharp”) or
(http.user_agent contains “Scrapy”) or
(http.user_agent contains “SeznamBot”) or
(http.user_agent contains “Sogou”) or
(http.user_agent contains “spbot”) or
(http.user_agent contains “Uptimebot”) or
(http.user_agent contains “WebDAV-MiniRedir”) or
(http.user_agent contains “WinHttp.WinHttpRequest”) or
(http.user_agent contains “YandexBot”) or
(http.user_agent contains “ZmEu”) or
(http.user_agent contains “Yowser”) or
(http.user_agent contains “SiteCheck”) or
(http.user_agent contains “AspiegelBot”) or
(http.user_agent contains “LinkCheck”) or
(http.user_agent contains “Yandex”) or
(http.user_agent contains “muckrack”) or
(http.user_agent contains “Qwantify”) or
(http.user_agent contains “BUbiNG”) or
(http.user_agent contains “knowledge”) or
(http.user_agent contains “CFNetwork”) or
(http.user_agent contains “SemrushBot”) or
(http.user_agent contains “Baiduspider”) or
(http.user_agent contains “python-requests”) or
(http.user_agent contains “crawl” and not cf.client.bot) or
(http.user_agent contains “bot” and not http.user_agent contains “bingbot” and not http.user_agent contains “Google” and not http.user_agent contains “Twitter” and not cf.client.bot) or
(http.user_agent contains “Bot” and not http.user_agent contains “Google” and not cf.client.bot) or
(http.user_agent contains “spider” and not cf.client.bot) or
(http.user_agent contains “ZmEu”)

Hi there, you may check this article https://support.cloudflare.com/hc/en-us/articles/115001856951-Understanding-Cloudflare-User-Agent-Blocking

You can set rules as how you want it.

Here’s where you blocked it:

I guess the IP address in that firewall event wasn’t allowed, after all.

It’s possible. Add a Firewall Rule to check if User Agent “contains” umbrella, then Allow. And make that the first rule on your list.

2 Likes

This is what I ended up doing - create firewall rule to allow user agents ‘Umbrella bot’ and ‘WPUmbrella’ and changed the expression in my existing rule, from ‘and’ to ‘or’. That seems to have done the trick.

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.