At 21:00 UTC on October 11, 2023, we observed degraded performance with the Object Storage Service in our Frankfurt Datacenter following a scheduled maintenance that was performed on October 10th, 2023. After being alerted to the degraded performance we immediately initiated our incident response procedure.
We began investigating the issue and identified a bug within the software used by our Object Storage Service, which was causing performance degradation. We deployed a bug fix and the issue was mitigated by 00:20 UTC on October 12, 2023. Once the fix was deployed no further performance issues were observed, and the issue was declared resolved at 01:34 UTC.
As a result of this incident, we have taken measures to investigate the root cause of this bug and have implemented further auditing to prevent recurrence.