Back to overview

Prediction delays for black-forest-labs/flux-1.1-pro and meta/meta-llama-3-70b-instruct

Nov 08 at 07:05pm UTC
Affected services
Prediction serving

Resolved
Nov 08 at 07:05pm UTC

Between the hours of 16:30 - 19:00 UTC, predictions sent to flux-1.1-pro and meta-llama-3-70b-instruct were delayed by up to 1 hour. This was the result of a rollout of an internal component that broke a small number of models which we then rolled back. Due to the high volume of predictions handled by these two models, the backlog grew fairly quickly, but we have now caught up with all queued predictions.