Hing high latency and downtime of load balance failover

Hi, I am experiencing high latency and downtime of load balance failover even though further checks suggest that there’s no downtime at the ISP level, however, both origins configured are going down at the same time