We recently addressed issues affecting Uploads, Downloads, Logins, Public API and Box Sign. We would like to take the opportunity to further explain these issues and the steps we have taken to keep them from happening in the future.
Between 5:24 pm PDT and 5:30 pm PDT on August 22, 2023, some users may have experienced difficulties while working in Box. During this time, some Box users may have experienced increased errors or slowness when accessing Box.com, Uploads, Downloads, Public API, Logins and Box Sign. The issue occurred due to a misconfiguration being applied during an upsize process on one of our database pods, which caused the database pod to become unhealthy when load increased during the issue. We were able to resolve the issue by deploying the correct configuration. In addition, we will be adding alerts to detect the misconfiguration so it can be fixed before causing impact.
The database pod involved in this issue was manually upsized on August 3rd as a proactive measure in case of high load. The upsize process used an incorrect command that misconfigured the pod such that it was not able to take advantage of the increased capacity during the issue. During the period of time immediately after the upsize and before the issue, there was an opportunity to detect the misconfiguration and fix it before causing impact, but there is currently no alert in place for that detection.
The following corrective actions have been completed or are planned:
We are continuously working to improve Box and want to make sure we are delivering the best product and user experience we can. We hope we have provided some clarity here and we would be happy to answer any questions you may still have regarding this matter.
The Box Team