[Issue Update] Outage reason:
Render unauthorizedly overwrote the DNS zones on Cloudflare
For Render users, their DNS zones on Cloudflare were unauthorizedly
overwritten by Render at 1am Sep 14, 2021 (UTC). All root domains went
down and were pointed to a Fastly IP unexpectedly.
We use Render to host static sites and Cloudflare as the DNS provider. Thus, Our root domains were hijacked due to the bug. For details, please check Render unauthorizedly overwrote the DNS zones on Cloudflare - #16 by chennien1990 .
It seems like there was an upgrade of CNAME setup and bulk SSL renewals on Cloudflare yesterday. For the sites activated with CNAME setup, their root domains went down at around 01:00, Sep 14 2021 (UTC); while www and sub-domains were unaffected. As the attached image shown, a strange error message “Not Found” is displayed on every page of the affected domains.
I have several websites activated with CNAME setup via hosting providers’ dashboards. Thus, I tried to make them fix with the following actions, but still not work and realized there might be a bug.
- purged caches
- re-created the A/AAAA record of root domains
- changed root domain’s IPv4/6 address to another servers & different ISPs
- deleted the purchased certificates
- disabled and enabled universal SSLs
- switched to NS setup