Llama-3.1-8b-instant model Degraded Performance

This incident has been resolved.

The issues affecting llama-3.1-8b-instant have been resolved. The model is operating normally. Thank you for your patience.

We have fix and performance is improving. We’re now monitoring the model to ensure stability. If all remains normal, we will resolve the incident in the next update.

We have identified the problem affecting the llama-3.1-8b-instant service. A fix is in progress. Users may still see impact until the fix completes.

We are currently investigating reports of an issue with the llama-3.1-8b-instant model. Users may be experiencing repeated performance degradation, with significant spikes in response times and increased 503 errors across several regions. The team is investigating.