Tunnel works one day and next stops working

I am running a cloudflare tunnel that goes to my Nextcloud instance running in a VM. I have an issue where one day the tunnel works fine and the next it stops working and returns a Bad Request error then randomly starts working again and so on…

When looking at the cloudflared logs this is what it gives me:

2023-05-25T05:57:39Z ERR error="Unable to reach the origin service. The service may be down or it may not be responding to traffic from cloudflared: dial tcp 192.168.0.4:443: connect: connection refused" cfRay=7ccb8ac91ed727c0-PRG event=1 ingressRule=5 originService=https://192.168.0.4:443

Apparently it can’t reach the service on that IP. Yet I can navigate to that domain locally without issue. It is not down.

Has anyone else experienced this? Any help would be appreciated!

Update: It really seems like it is working on even days and stops working on uneven days.

So bizarre