We have identified and pushed a fix at 9:58pm PST so future jobs will not be affected, in addition with remedying many of the existing jobs.

Customers will not be billed for any extra compute used during this time period.

For jobs that called several child jobs, we noticed an issue starting at 12:43pm PST that would happen due to preemption-based retries in children not being properly caught in the parent.