← Back to GitHub History
minor✓ Resolved

Incident across several services

GitHub•
Status
resolved
Duration
18h 49m
Updates
14
Coverage
0 articles

INCIDENT TIMELINE

✓ Resolved
This incident has been resolved.
investigating
We are continuing to process the backlog of issue label updates for Projects. Label changes may still be delayed. All other services are operating normally.
investigating
We are continuing to process the backlog of issue label updates for Projects. Users may still see delays before label changes are reflected in Projects. All other services are operating normally.
investigating
We've deployed a change intended to accelerate processing of the backlog of issue label updates in Projects. A sizable backlog still remains and we continue working through it. All other services are operating normally. We will provide another update within the next hour.
investigating
Updates to issue labels may be delayed in being reflected in Projects. We are continuing to deploy a change that will accelerate processing of the backlog of label updates. All other services are available. We will provide another update within the next hour.
investigating
We are preparing to deploy a change that will mitigate the impact.
investigating
Continuing to investigate the lag that may be experienced in issue labels being accurately reflected in Projects. We are working on alternate solutions to process the backlog of label updates.
investigating
We will post another update in approximately one hour to share our progress.
investigating
Updates to issue labels may be delayed in being reflected in Projects by about ~10 minutes. We have added some capacity to work through the backlog more quickly, but it'll likely be a few hours to complete processing the full backlog of messages. All other services are available.
investigating
Users may experience stale Project search results. We are working to increase indexing speed. All other services are available.
investigating
We are seeing recovery for Projects. Users may experience stale search results for Projects while indexing catches up.
investigating
The degradation affecting API Requests has been mitigated. We are monitoring to ensure stability.
investigating
Database replicas have been restored. Org creation and the GitHub API are no longer degraded.
investigating
Database replicas have detached. We're working to restore the database replicas. Users may experience issues beyond creating organizations and a degraded experience with the GitHub API and Projects.
investigating
We are investigating reports of degraded performance for API Requests

📊 TECHNICAL DETAILS

Internal ID
b1e6da6d-359e-4217-97f0-1454f8760ee9
External ID
8zc63m64hy36
🕐 Started
🔄 Last Updated
✓ Resolved
MINOR
Impact Level
18h 49m
Total Duration
14
Status Updates
Affected Components
API Requests
REQUEST COVERAGE
No article has been written for this incident yet. When 100 people request coverage, we request generation of one.
0 / 100 requests100 more needed