Production API Error Elevation

Incident Report for Alloy

Resolved

Our API had a major outage between 16:45 and 17:00 ET (15 minutes) today due to a lock on a critical table in our core database. This lock was caused by an extremely large and miscategorized amount of information getting run simultaneously. We are currently working through a plan to flag this type of usage and create other mitigating controls for this type of situation.

Posted Aug 10, 2021 - 17:28 EDT

Monitoring

A fix has been implemented and we are monitoring the results.

Posted Aug 10, 2021 - 17:05 EDT

Investigating

Our API integration tests have encountered an increase in errors. We are currently investigating. Stay tuned for updates.

Posted Aug 10, 2021 - 16:49 EDT

This incident affected: Production API and Sandbox API.