← Back to Fly.io History
major✓ Resolved

Setting secrets and creating apps is degraded

Fly.io•Wed, Mar 11, 2026, 09:19 AM
Status
resolved
Duration
2h 20m
Updates
3
Coverage
0 articles

INCIDENT TIMELINE

✓ ResolvedWed, Mar 11, 2026, 11:40 AM
This incident has been resolved.
monitoringWed, Mar 11, 2026, 11:03 AM
While the secret storage service was in a read-only state, app creation requests queued up, due to the retry logic and insufficient request concurrency limits in our GraphQL API. We have scaled up the GraphQL API and are continuing to monitor the situation.
monitoringWed, Mar 11, 2026, 10:14 AM
A fix has been implemented and we are monitoring the results.
identifiedWed, Mar 11, 2026, 09:19 AM
An ongoing data migration in our secret storage service is causing degraded Machines API functionality.

📊 TECHNICAL DETAILS

Internal ID
a559c0c9-72bc-4d7d-a5c3-08bf88fb2029
External ID
t2zclr5m459y
🕐 Started
Wed, Mar 11, 2026, 09:19 AM
🔄 Last Updated
Wed, Mar 11, 2026, 11:40 AM
✓ Resolved
Wed, Mar 11, 2026, 11:40 AM
MAJOR
Impact Level
2h 20m
Total Duration
3
Status Updates
Affected Components
Machines APIDeployments
REQUEST COVERAGE
No article has been written for this incident yet. When 100 people request coverage, we automatically generate one.
0 / 100 requests100 more needed