Linode Status

Current Status

Service Issue - Cloud Manager and API

Incident Report for Linode

Postmortem

Starting 19:00 UTC on Jul 17, 2023, a performance issue with Linode's backend database impacted performance of the Linode Cloud Manager as well as the Linode API. This resulted in customers experiencing slow response times, or being unable to access their accounts or issue API calls. This incident did not impact access to existing services.

The team was made aware of the issue at 19:09 UTC, and our database administrators immediately began investigating. At 19:35 UTC, the administrators started clearing out database queries causing the contention and performance issues. By 20:00 UTC, we were able to confirm the database was once again performing as expected.

The root cause of the performance issues was the use of locking facilities in our database layer, which have been modified to mitigate this type of problem.

Posted Sep 11, 2023 - 20:32 UTC

Resolved

We haven't observed any additional issues with the Cloud Manager or API, and will now consider this incident resolved. If you continue to experience issues, please contact us at 855-454-6633 (+1-609-380-7100 Intl.), or send an email to support@linode.com for assistance.
Posted Jul 18, 2023 - 01:21 UTC

Monitoring

At this time we have been able to correct the issue affecting the Cloud Manager and API. We will be monitoring this to ensure that the service remains stable. If you are still experiencing issues and unable to open a Support ticket, please call us at 855-454-6633 (+1-609-380-7100 Intl.), or send an email to support@linode.com.
Posted Jul 17, 2023 - 21:42 UTC

Identified

Our team has identified the issue affecting the Cloud Manager and API as performance issues impacting the backend Linode database. We are working quickly to implement a fix, and we will provide an update as soon as the solution is in place. During this time, customers may continue to experience delayed responses or timeouts when utilizing Cloud Manager or the Linode API.
Posted Jul 17, 2023 - 20:44 UTC

Investigating

Our team is investigating a service issue affecting the Linode Cloud Manager and API which started at ~18:00 UTC. During this time, some users may experience delays or timeouts when attempting to access these systems. We will share additional updates as we have more information.
Posted Jul 17, 2023 - 19:51 UTC
This incident affected: Linode Manager and API.