Issues with metered billing report generation

This incident has been resolved.

The degradation has been mitigated. We are monitoring to ensure stability.

We have applied mitigations to a data store related to billing reports, and are seeing partial recovery to billing report generation. We continue to monitor for full recovery.

We are seeing a high number of 500s due to timeouts across GitHub services. We are redeploying some of our core services and we expect that this allow us to recover.

We're continuing to see high failure rates on billing report generation, and are working on mitigations for a data store related to billing reports.

We're seeing issues related to metered billing reports, intermittently affecting metered usage graphs and reports on the billing page. We have identified an issue with a data store, and are working on mitigations.

We are investigating reports of impacted performance for some GitHub services.