I would like to warn you that removing IPv4 records and leaving only IPv6 will possibly cause random issues with connections to your website. I did this a while ago to completely just block IPv4 access in my backend which increases security but I kept getting compeltely random 502 errors throughout the day. This is only my experience so you might have better luck.