Cloudflare can't find ruleset and blocking legitimate traffic

We’re getting legitimate traffic blocked for our site.

I added the IP address to the firewall rules, and now the Security screen shows two events: one for allow and one for blocked for each request.

The blocked requests show an error when we open them: Could not find ruleset (ruleId) and the Ruleset name is “Unavailable”

How can we resolve this?