A 524 error means your server didn’t respond in time to Cloudflare requests. If it is midnight, do you have any scheduled jobs running on the server at that time that increase the load such that it can’t respond to requests?
You can pause Cloudflare rather than change the nameservers to check what you can see at the time when bypassing Cloudflare.