Cloudflare Access JWT token is invalid

I’m trying to set up Cloudflare Access using JWT tokens. When I follow the instructions and copy the token from my CF_Authorization cookie and the public key into jwt.io I always get “invalid signature”. What am I doing wrong?

Be sure to replace the \n in the public key with new lines. Once I did that, it said “Signature Verified”.