This issue appears to have been a result of another bandwidth spike partly as a result of our incident earlier today. The issue has now been resolved. We are going to be working to prevent incidents of this kind from recurring.

Requests for predictions made on models and deployments running on H100 and L40S instances are taking a long time to respond and sometimes timing out.

We're trying to establish the cause of the issues.