Previous incidents

May 2025
May 29, 2025
1 incident

Sieve Job Processing is Degraded

Resolved May 29 at 07:41pm PDT

Jobs were backed up due to an issue with our cloud provider. The immediate problem is resolved and we are now working through the backlog of jobs

Issue has been resolved

May 05, 2025
1 incident

Several Sieve APIs stuck in processing

Downtime

Resolved May 05 at 06:14pm PDT

Job processing issue has been resolved. All jobs should complete normally

1 previous update

April 2025
Apr 07, 2025
1 incident

API requests have slow roundtrip time

Degraded

Resolved Apr 08 at 02:30am PDT

This issue is resolved. A full RCA can be viewed here:

https://docs.google.com/document/d/1h79gU9BnvsVNplL2N7n60Uwq5SLMibGhrfqbMxN66cc/edit?tab=t.0

1 previous update

Apr 06, 2025
1 incident

1 in 20 API requests are hanging or failing with 500s

Downtime

Resolved Apr 07 at 03:00pm PDT

This issue is resolved. Full RCA can be viewed here:

https://docs.google.com/document/d/1KLIZIAYAuy5XgmIy8lInfxQcgT32DyIN4O58gfM3Dsg/edit?tab=t.0

1 previous update

Apr 04, 2025
1 incident

File servers overwhelmed causing dubbing, autocrop slowdowns

Resolved Apr 08 at 03:46pm PDT

.

1 previous update

March 2025
Mar 13, 2025
1 incident

sieve/youtube-downloader suffering long queue times, several other functions ...

Degraded

Resolved Mar 13 at 07:10am PDT

We've root caused and fixed the issue, the full RCA is written below:


Root Cause Analysis (RCA) - March 13, 2025

Incident Summary:

On March 13, 2025, between 2:30 AM - 5:30 AM PST, a large push of jobs by our internal team to the sieve/youtube-downloader function caused a queue buildup, stalling customer requests to this function. This overwhelmed the servers responsible for video file CRUD operations, affecting multiple functions that generate and output video files. The issue w...

1 previous update