Queues for predictions remain fairly high for black-forest-labs/flux-schnell and meta/meta-llama-3.1-405b-instruct. All other models should be behaving normally.

We performed a rollback shortly after identifying the problem and we are seeing most services recovering, however much more slowly than expected. We are also investigating a potential problem with one of our caching layers.

We are investigating alerts for website availability