Unable to set up sippy between S3 and R2

Both the website and wrangler respond with “Invalid R2 credentials [code: 10063]” when I try to make an incremental migration.

This is both for the autocreated R2 credentials using the site, and manually created R2 credentials used with wrangler.

This seems to be related to EU jurisdiction, the setup worked with a new bucket on auto region.