On January 17, 2025 at approximately 18:48 UTC, we exhausted the set of IP addresses allotted for NodeBalancers in the US-ORD data center. This prevented the provisioning of new NodeBalancers in that data center.
In response, we added additional capacity for IP addresses in that location, and the issue was mitigated at approximately 19:25 UTC. To prevent a recurrence of this situation, we have added further capacity since this event and monitoring solutions will be implemented to ensure the continued stability of the platform.
This summary provides an overview of our current understanding of the incident given the information available. Our investigation is ongoing and any information herein is subject to change.