Service Issue - NodeBalancers Widespread
Postmortem
On October 7th, 2025 starting at approximately 16:07 UTC, a misconfiguration caused by a firewall update in one of our data centers resulted in IPv6 connections for our NodeBalancer service to be blocked. Due to the reliance of NodeBalancer infrastructure on IPv6, this caused customers to experience issues with provisioning NodeBalancers and editing NodeBalancer configurations during the period of impact.
After identifying the update as the cause of the issue, the database team reverted the changes made, which restored service at 20:10 UTC on the same date.
Since this event, we have redeployed the firewall update successfully and have verified that IPv6 connections are working as expected. To prevent recurrences of this issue, we are examining our current practices on updating essential databases and are taking steps to improve monitoring to better detect IPv6-related errors proactively.
This summary provides an overview of our current understanding of the incident given the information available. Our investigation is ongoing and any information herein is subject to change.
Resolved
Monitoring
We can confirm that we have been able to correct the issues affecting the NodeBalancer service at approximately 20:10 UTC on October 7th, 2025. We will be monitoring this to ensure that it remains stable. If you continue to experience problems, please open a ticket with our Support Team.