RDP Tunnel Connector throwing Frequent Bad Handshake Error on Linux Client

Hi Community,
Some context: Back in December last year, I setup my first Cloudflare Tunnel with a public domain, all on my own. My goal was to be able to access my Home Desktop from anywhere around the world. I followed the documentations end to end starting from how to setup my domain with Cloudflare’s DNS and then setting up my server and client cloudflared tunnel connectors. Now, here’s some information about my server and client system(s):
Server (Home Desktop that I access): Windows 11 Pro Operating System, updated with latest OS update, Cloudflare version 2023.x.x
Client 1 (Primary): Mac OS X Sonoma, updated with latest OS update, cloudflared version 2024.3.0
Client 2 (Secondary): Ubuntu 22.04 LTS, updated with latest OS update, cloudflared version 2024.3.0

I have always been able to connect my Mac to my Desktop over RDP and have never faced any trouble. I had followed dashboard setup steps to setup the cloudflared connector. Before connecting, I just run this command cloudflared access rdp --hostname rdp.example.com --url rdp://localhost:3389 where rdp.example.com is my own domain and then I am able to successfully connect to my desktop, no issues till now.
Just to add on, I also had added an access application earlier to have a kind os 2FA when connecting to my desktop but I removed that just sometime back and still I haven’t faced any issues.

Now, the real issue I started facing when I brought in my 2nd client machine with Ubuntu (freshly installed). Followed the same steps to setup the cloudflared connector through dashboard setup guide (install cloudflared as system service). Then same as my Mac, I launch the cloudflared RDP port forwarding command stated earlier. The problem I am facing is, this time on my Linux system, I am able to connect to my desktop only like 4-5 times out of 25-30 attempts I make to connect. Everytime I am getting this error in terminal:

ERR failed to connect to origin error="websocket: bad handshake" originURL=https://rdp.example.com

I mean I am not able to understand what is going wrong and why is this occurring like on chance basis. I have been facing this issue consistently since past 10 days. (Also, I try to connect only 1 client at a time, either my Linux or my Mac system, but not both of them simultaneously) Can someone please help me out with this? I have gone through the documentations again like 2-3 times read everything line by line, went through posts of other people facing similar issues, tried everything but nothing really worked out.
Quick help would be really really appreciated here!

Hi. I don’t know if you finally solved the issue.

I would like to share that in my case I realized that Super Bot Fight Mode was causing it. I created exceptions to skip the SBFM under my tunnel subdomains.

I hope this help to you or anyone else.