Elevated 500 rates on API responses

This incident has been resolved.

The root cause has been identified and addressed. We will continue to monitor going forward.

We have deployed a fix for this issue and our services appear to have returned to normal operation. We continue to monitor.

We have deployed a fix and are observing rapid decline in error rates. We continue to monitor the situation.

We are continuing to work to deploy a mitigation for the backend API and Dashboard issues.

We are deploying a mitigation for the Dashboard and Backend API

We have implemented remediation for our session service. We are still investigating remediation for the Dashboard and backend API.

We are investigating elevated 500s affecting a subset of our API responses.