Google Workspace – Failed to fetch group information from the identity provider

I’ve set up Google Workspace oauth integration but when I press “Test” I’m getting “Failed to fetch group information from the identity provider” error.

I’ve tried to completely re-create google cloud project, enable Admin API and create oauth credentials again – same problem
How can I troubleshoot this?