Previous incidents

We've root caused and fixed the issue, the full RCA is written below:

Root Cause Analysis (RCA) - March 13, 2025

Incident Summary:

On March 13, 2025, between 2:30 AM - 5:30 AM PST, a large push of jobs by our internal team to the sieve/youtube-downloader function caused a queue buildup, stalling customer requests to this function. This overwhelmed the servers responsible for video file CRUD operations, affecting multiple functions that generate and output video files. The issue w...

Root Cause Analysis (RCA)

Incident Summary:
On [date/time of the incident], our services experienced a disruption due to a database service undergoing automatic maintenance. This maintenance reset the DNS configuration, causing our systems to lose connection to the database. The issue persisted because the affected services did not reestablish the connection properly.

Additionally, certain users experienced degraded performance for approximately 3 hours following the incident. These users h...