THIS IS A SCHEDULED EVENT Sep 22, 10:00 - 12:00 UTC Sep 16, 18:41 UTC Scheduled - An upstream provider is performing network maintenance on a subset of hosts in ORD on 2026-09-22, from 09:00 UTC (04:00 local time) to 11:00 UTC (06:00 local time). A loss of connectivity for up to 30 minutes is expected within the scheduled maintenance window.
Sep 15, 05:34 UTC Resolved - This incident has been resolved. Sep 15, 04:51 UTC Monitoring - A fix has been implemented and we are monitoring builds. Standard flyctl builds should be working again for customers in all regions. Sep 15, 04:45 UTC Identified - We have identified an issue with deploying via Depot for users connecting through our SYD and JNB regions. Affected customers in these regions…
Sep 12, 22:12 UTC Resolved - This incident has been resolved. Sep 12, 21:57 UTC Monitoring - Private networking between Fly Machines is resolved, and most outbound connections are healthy. We're continuing to monitor the network, and some issues will still be expected from clients physically located in US West until upstream transit issues are resolved. Sep 12, 21:22 UTC Investigating - We are inv…
Sep 3, 00:41 UTC Resolved - This incident has been resolved. Sep 2, 23:33 UTC Monitoring - Error rates have decreased. We are continuing to monitor the API health. Sep 2, 23:03 UTC Investigating - We're aware of a problem affecting a subset of Sprites users. We are investigating the source of the issue.
Sep 2, 15:57 UTC Resolved - This incident has been resolved. Sep 2, 15:33 UTC Monitoring - A fix has been implemented and we are monitoring the results. Sep 2, 14:56 UTC Update - We're updating the affected region list to also include SJC since this seems to be a wider upstream issue in US West Coast. Sep 2, 14:48 UTC Update - We have put in some temporary mitigations along with our providers. How…
Sep 2, 07:44 UTC Resolved - This incident has been resolved. Sep 2, 07:31 UTC Monitoring - A fix has been implemented and we are monitoring the results. Sep 2, 07:21 UTC Investigating - We are investigating an issue with the background job runner for our API. Actions that require a background job, such as creating apps, assigning IP addresses, or creating/renewing certificates, may fail at this ti…
Aug 31, 21:48 UTC Completed - The scheduled maintenance has been completed. Aug 31, 21:00 UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Aug 29, 00:19 UTC Scheduled - We will be performing rolling maintenance for a small number of hosts across all regions. Machines on affected hosts may experience brief 6PN connectivity issues (under one min…
Aug 31, 15:30 UTC Resolved - A configuration update caused temporary failures for incoming HTTP/2 traffic for Fly Machines located on a subset of hosts for a few minutes. This incident has since been resolved.Managed Postgres depends on HTTP/2 and some control plane ops may have been affected as well. However, downstream Postgres connections were unlikely to have been affected by this since they d…
Aug 31, 08:10 UTC Resolved - This incident has been resolved. Aug 31, 07:39 UTC Monitoring - Packet loss in ORD is improving and impacted services are recovering; we’re continuing to monitor for intermittent issues Aug 31, 06:26 UTC Investigating - Due to an upstream provider, we are seeing ~50% packet loss on a subset of hosts in ORD. Some MPG clusters in ORD are slow to replicate as a result.
Aug 30, 22:45 UTC Resolved - We saw Sprite deletion jobs failing between 21:18 and 22:05 UTC. This issue has been resolved.
Aug 28, 22:36 UTC Resolved - This incident has been resolved. Aug 28, 22:36 UTC Update - Our upstream provider has implemented a fix. Network performance in GRU has normalized. Aug 28, 22:12 UTC Identified - We are seeing a recurrance in networking issues in GRU. Some apps in the region may experience increased latency or packet loss. We are working with our upstream networking provider to resolve…
Aug 28, 10:22 UTC Resolved - This incident has been resolved. Aug 28, 08:09 UTC Investigating - We are currently investigating this issue.
Aug 27, 18:00 UTC Completed - The scheduled maintenance has been completed. Aug 27, 16:00 UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Aug 27, 14:02 UTC Scheduled - We will be performing maintenance on our global anycast network to add new capacity. Long-running connections, such as WebSocket, will need to reconnect, and a small amount of…
Aug 26, 18:43 UTC Resolved - This incident has been resolved. Aug 26, 18:33 UTC Update - Our testing and monitoring indicates gateways should be back to normal; if you are still having problem using `flyctl ssh console`, try restarting the `flyctl` agent by `flyctl agent restart`. Aug 26, 18:27 UTC Monitoring - A fix has been implemented and we are monitoring the results. Aug 26, 18:14 UTC Investi…
Aug 24, 13:24 UTC Resolved - This is now resolved Aug 24, 12:47 UTC Monitoring - All hosts have caught up with metrics and we're monitoring the situation Aug 24, 10:23 UTC Investigating - We are currently experiencing some metrics lag on servers in some regions. We are provisioning more metric processing instances to accommodate the backlog and catch up.
Aug 23, 02:10 UTC Resolved - This incident has been resolved. Aug 23, 02:04 UTC Monitoring - Upstream networking issues have resolved. Aug 23, 01:28 UTC Investigating - We are investigating network issues in the Los Angeles region. Apps may experience higher latency or be unreachable at this time.
Aug 20, 19:30 UTC Resolved - A BGP configuration error caused our Anycast DNS to route to some nodes without the proper DNS infrastructure. The issue was temporary and was resolved as soon as we removed that node from BGP.
Aug 20, 14:16 UTC Resolved - This incident has been resolved. Aug 20, 14:05 UTC Monitoring - A fix has been deployed and this error should no longer be occurring. We're monitoring to ensure full recovery. Aug 20, 13:54 UTC Identified - We have identified an issue causing authentication errors for some operations from `flyctl`. These operations are failing with an error like: `This endpoint no long…
Aug 20, 07:57 UTC Resolved - This incident has been resolved. Aug 20, 07:32 UTC Monitoring - A fix has been implemented and we are monitoring the results. Aug 20, 07:26 UTC Update - We are continuing to investigate this issue. Aug 20, 07:25 UTC Investigating - We had an issue with the ord-0 Fly Kubernetes cluster, and many MPG clusters are failing to restart. Our MPG team is actively working on it…
Aug 19, 00:00 UTC Resolved - 6PN networking issues between some machines in YYZ during a rollout which was rolled back once we noticed errors. During this time some machines were unable to talk to internal resources like other DBs, other apps or MPG clusters.
Aug 17, 15:41 UTC Resolved - The capacity issue in the ARN region has been resolved. Aug 17, 13:19 UTC Investigating - New machines may fail to create in ARN because we lack capacity.
Aug 14, 20:33 UTC Resolved - This incident has been resolved. Aug 14, 20:08 UTC Monitoring - We have failed over the secrets database to a replica, and the Machines API appears healthy now. We are monitoring for any further issues. Aug 14, 19:30 UTC Identified - We are working to recover our secrets service after a failed deployment. Apps continue to run, but it is not possible to create new apps…
Aug 14, 20:31 UTC Resolved - The secrets service has been fully restored.
Aug 13, 19:41 UTC Resolved - This incident has been resolved. Aug 13, 18:37 UTC Update - We are continuing to monitor for any further issues. Aug 13, 18:36 UTC Monitoring - A fix has been implemented and we are monitoring the results. Aug 13, 18:14 UTC Identified - The issue has been identified and a fix is being implemented. Aug 13, 17:51 UTC Update - We are continuing to investigate this issue.…
Aug 13, 16:00 UTC Completed - The scheduled maintenance has been completed. Aug 13, 13:00 UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Aug 7, 21:11 UTC Scheduled - An upstream provider is performing network maintenance on a subset of hosts in ORD on 2026-08-13, from 13:00 UTC to 16:00 UTC. A loss of connectivity of up to 30 seconds is poss…
Aug 9, 07:10 UTC Resolved - This incident has been resolved. Aug 9, 06:42 UTC Monitoring - A fix has been implemented and we are monitoring the results Aug 9, 06:03 UTC Update - We’ve deployed an additional mitigation to further reduce Corrosion retry pressure and are seeing improvement; we’re continuing to monitor while remaining affected nodes catch up. Aug 9, 04:58 UTC Update - We’ve applied a…
Aug 5, 20:41 UTC Resolved - Etcd is stable. Services are back to normal. Aug 5, 20:26 UTC Identified - High CPU pressure on a shared etcd instance is causing lags on MPG creation in the IAD region
Aug 5, 03:22 UTC Resolved - This incident has been resolved. Aug 4, 20:59 UTC Monitoring - We tweaked hosts to allow for more machine allocation. We'll be monitoring the region over the next hours. Aug 4, 19:03 UTC Identified - New MPG clusters may fail to create in GRU because we lack capacity.
Aug 4, 23:58 UTC Resolved - This incident has been resolved. Aug 4, 20:36 UTC Monitoring - A fix has been implemented and we are monitoring the results. Aug 4, 18:26 UTC Update - We have the size of TLS certificate issuance backlog under control, but are still seeing some remaining issues and are currently working to clean up the edge cases. Aug 4, 17:02 UTC Identified - We believe we have identif…
Aug 3, 18:50 UTC Resolved - A BGP misconfiguration while provisioning new edge capacity caused most traffic from Europe endpoints to be dropped, between 14:50 UTC and 15:02 UTC. The misconfiguration has been fixed and we are implementing safeguards against this kind of issue in the future.