Initial Server Response Time is high

Hi,

I realized when I route my VPS through Cloudflare DNS, it shows me “Initial Server Response Time is High” in the pagespeed.web.dev website while testing the performance of my website. On the other hand, when I test a website which is not routed through Cloudflare DNS and hosted on the same VPS, it doesn’t show me this issue. The websites are:

Hosted on my VPS through Cloudflare DNS: https://www.erpweblog.com
Hosted on my VPS without Cloudflare DNS: https://www.astrokaka.in

Not sure what to do to fix the server response time. I would appreciate it if someone could please help me sort this out.

Thanks

Vikas