At this time service has been restored. All inference (prediction serving) and model instance starts have returned to normal.

This incident is causing disruption of prediction serving and model instance start.

The root cause has been identified as being related to a maintenance on our provider's networking core. We are awaiting service restoration with our provider.

This incident impacts A40, A100-80, and a subset of the A100-40G hardware types.

We are aware of an issue within one of our providers that is causing degraded performance with regards to prediction serving. We are monitoring the situation and will provide updates as information becomes available.