Most models running on L40S hardware should not be experiencing delays. We are still seeing a handful of models unable to setup due to download rate limiting from a few external providers, but we're going to continue working on that as a separate problem. Thanks for waiting!

We are still in the process of recovering, and most models are working correctly at this point. The remaining models that have backed up queues all appear to be hitting download rate limiting from external providers. We are working with the relevant providers to see if any interventions are available.

We are handling a surge of demand for models running with the L40S hardware type which is resulting in delayed predictions.