Sep 14, 16:00 EDT Resolved - We've resolved an issue loading Admin Portal links for customers without custom domains. If you're still experiencing issues please contact support. Sep 14, 15:16 EDT Monitoring - We've fixed an issue affecting Admin Portal links for customers without custom domains and are monitoring. Sep 14, 15:08 EDT Investigating - We are investigating an issue loading Admin Portal…
Sep 9, 19:02 EDT Resolved - We have identified the source of the problem. A configuration change that applied to roughly 2% of organizations using a custom domain for hosted Authkit resulted in form submission errors. The configuration has been reverted and service restored. Sep 9, 17:00 EDT Investigating - We are seeing an elevated error rate for some customers for POST requests. This appears to…
Sep 2, 15:06 EDT Resolved - Static assets delivery rates have recovered. Sep 2, 14:33 EDT Monitoring - We have mitigated the issue and are continuing to monitor. Sep 2, 12:39 EDT Identified - We have identified increased failures delivering static assets to end users with strict network allowlists. A fix is in progress.
Aug 31, 10:45 EDT Resolved - This degradation in delivery was limited to upstream testing infrastructure which has since recovered. There was no external impact. Aug 31, 10:10 EDT Investigating - We are investigating an issue with successful delivery of emails.
Aug 27, 10:04 EDT Resolved - The mitigation is in place and errors rates have returned to normal. We will continue to monitor. Aug 27, 09:48 EDT Monitoring - Vault pages in the Dashboard started showing increased errors and timeouts starting Aug 26 at 18:00 UTC. We have addressed the issue and are monitoring.
Aug 25, 14:41 EDT Resolved - This incident is resolved. Aug 25, 13:54 EDT Monitoring - We have confirmed our fix resolved the elevated errors affecting sign-in to the WorkOS Dashboard and are continuing to monitor. Aug 25, 13:41 EDT Identified - We have applied a fix and are monitoring the system to verify that Dashboard sign-in is recovering. Aug 25, 13:35 EDT Investigating - We are investigating…
Aug 18, 20:00 EDT Resolved - On August 18 from 23:59 to 00:03 UTC (August 19), a subset of API requests (primarily AuthKit authentication endpoints) returned HTTP 500 errors. Automatic maintenance of a large, seldom-used internal index caused brief write-ahead-log contention on a primary database that exhausted connection capacity; service recovered automatically within four minutes. We identified…
Aug 16, 18:04 EDT Resolved - Microsoft's Outlook team has confirmed that mitigations have been implemented. We've verified that email delivery to Microsoft 365 domains is operating normally again.This incident has been resolved. Aug 15, 12:21 EDT Identified - We continue to see email deliverability issues to a subset of Microsoft 365 tenant domains. This does not affect consumer domains such as ou…
Aug 14, 16:45 EDT Resolved - This incident has been resolved. Email delivery was delayed between 15:45 EDT and 16:35 EDT due to an issue with an upstream email service provider. Aug 14, 16:44 EDT Monitoring - We've mitigated the impact and email delivery is returning to normal. Aug 14, 16:14 EDT Investigating - We're investigating delays in email deliverability.
Aug 11, 15:24 EDT Resolved - This incident has been resolved. Aug 11, 14:02 EDT Investigating - We are investigating intermittent sign-in failures on the WorkOS Dashboard. We will share an update as soon as possible.
Aug 5, 14:28 EDT Resolved - This was an issue with our internal telemetry - there is no customer impact. Sorry for the false alarm. Aug 5, 14:04 EDT Investigating - We are investigating an issue with our webhooks.We apologize for the inconvenience and will share an update once we have more information.
Jul 31, 14:06 EDT Resolved - The issue has been resolved. Jul 31, 13:10 EDT Monitoring - The fix has deployed, we are monitoring systems to verify the impact is fully mitigated Jul 31, 13:00 EDT Update - We have identified the issue and are deploying a fix. AuthKit SSO sign-on remains partially degraded for a small subset of customers; standalone SSO continues to be unaffected. We'll share another…
Jul 29, 15:54 EDT Resolved - This incident has been resolved. Jul 29, 15:24 EDT Monitoring - We have remediated the issue. Email delivery rates have recovered and reported email delivery status in Dashboard are being updated properly. We are continuing to monitor. Jul 29, 14:36 EDT Identified - We've identified the issue and have implemented a mitigation. We are seeing normal email deliverability…
Jul 27, 17:12 EDT Resolved - This incident has been resolved. Jul 27, 17:11 EDT Update - This has been resolved. Jul 27, 16:54 EDT Monitoring - We have confirmed that webhook delivery times are back to normal levels. We are continuing to monitor. Jul 27, 16:34 EDT Update - We have rolled out a fix and are seeing improvements to webhook delivery times. We will provide another update soon. Jul 27, 1…
Jul 27, 13:37 EDT Resolved - Email delivery is operating normally. Jul 27, 11:36 EDT Monitoring - We have remediated the issue. Email delivery rates have recovered and reported email delivery status in Dashboard are being updated properly. We are continuing to monitor. Jul 27, 10:33 EDT Update - We are continuing to investigate email delivery errors in addition to Dashboard email delivery statuses…
Jul 27, 09:04 EDT Resolved - Delivery rates have recovered. Jul 27, 08:11 EDT Monitoring - We have applied a refined mitigation and are continuing to monitor delivery rates. Jul 27, 07:20 EDT Investigating - Our mitigation did not fully resolve the issue. We are continuing to investigate. Jul 27, 07:03 EDT Monitoring - We have implemented a mitigation and are continuing to monitor. Jul 27, 06:05 E…
Jul 21, 22:51 EDT Resolved - This has been resolved. Jul 21, 22:19 EDT Monitoring - We've remediated the issue and are seeing email delivery recover. Jul 21, 22:16 EDT Identified - We've identified the issue and are implementing remediations. Jul 21, 21:35 EDT Investigating - We're investigating possible email delivery delays.
Jul 21, 17:54 EDT Resolved - We identified and fixed the issue. AuthKit SSO has fully recovered. Jul 21, 17:44 EDT Investigating - We are investigating SSO failures for AuthKit customers.
Jul 21, 15:49 EDT Resolved - Webhook latency is back to normal levels. We have identified that this latency only affected a very small subset of customers. Jul 21, 15:37 EDT Monitoring - We're seeing a return to normal webhook latency and are continuing to monitor. Jul 21, 15:09 EDT Identified - We've identified the source of the latency and have implemented a fix. Jul 21, 14:58 EDT Investigating…
Jul 16, 08:21 EDT Resolved - We've resolved the issue with email delivery delays. Jul 16, 08:18 EDT Identified - We've identified the issue causing email delays. We are working to mitigate the issue. Jul 16, 08:06 EDT Investigating - We're seeing delays in email delivery. Our team is investigating. We will share an update as soon as possible.
Jul 16, 06:44 EDT Resolved - This incident is resolved. Jul 16, 06:30 EDT Monitoring - We have deployed the fix and we are now monitoring our systems to ensure the issue is resolved. Jul 16, 06:11 EDT Identified - We've identified the cause of the elevated platform errors. We've implemented a fix and are seeing error rates decrease. Jul 16, 05:58 EDT Update - We continue to investigate elevated er…
Jul 10, 16:36 EDT Resolved - We have restored full service to the standalone MFA API endpoints. Jul 10, 15:26 EDT Monitoring - Beginning at at 16:00 UTC, users of our standalone MFA API experienced intermittent elevated error rates for approximately 2 hours. MFA through AuthKit was not affected. This issue has been resolved, and we are continuing to monitor.
Jun 25, 01:12 EDT Resolved - The remaining out-of-sync user records are now back in sync. Jun 24, 23:29 EDT Update - Synchronization has continued to catch up. We are continuing to monitor the few out of sync changes that are remaining. Jun 24, 20:09 EDT Monitoring - Provisioning has caught up for user creation, and new directory activity is syncing normally. We are still working through and monit…
Jun 22, 14:01 EDT Resolved - From 13:35 UTC to 14:24 UTC users connecting through our Chicago (ORD) edge node may have experienced elevated API error rates. We have resolved the issue and are monitoring. Jun 22, 10:42 EDT Monitoring - We detected elevated errors from our Chicago (ORD) edge node. Errors have since recovered and we're continuing to monitor. Jun 22, 10:03 EDT Investigating - We are i…
Jun 9, 05:00 EDT Resolved - From 9:43 to 10:02 UTC SSO endpoints experienced increased latency and intermittent timeouts. We have resolved the issue and are monitoring.
Jun 4, 20:49 EDT Resolved - The backlog of messages have been sent and system performance has returned to its expected state. Sending delays occurred between 2:50pm – 5:18pm PT. Jun 4, 20:34 EDT Monitoring - Email delivery has recovered. We're continuing to monitor. Jun 4, 20:08 EDT Update - Our email provider is continuing to work through the backlog and has scaled up to speed up the process. Jun…
May 28, 22:46 EDT Resolved - The issue affecting the Events API GET /events endpoint has been resolved. The fix has been deployed, and affected requests are now processing normally. May 28, 22:30 EDT Identified - We have identified the cause of the elevated errors affecting the GET /events API and are working on a resolution. We’ll share another update soon.
May 22, 14:58 EDT Resolved - This incident has been resolved. May 22, 14:55 EDT Monitoring - A fix has been deployed for the issue affecting static asset loading on the WorkOS Dashboard, Admin Portal, Docs, and hosted result pages. We are continuing to monitor for full recovery. May 22, 14:32 EDT Update - We're aware of a styling issue currently affecting the WorkOS Dashboard. CSS assets are faili…
May 19, 18:00 EDT Resolved - The webhooks queue backlog has been delivered. Thank you for your patience. May 19, 17:43 EDT Identified - We are experiencing delays delivering a subset of webhooks. We have identified the issue and working on a remediation.
May 14, 11:12 EDT Resolved - This issue is now resolved. May 14, 11:10 EDT Monitoring - We experienced errors in our OIDC connections. The issue is now resolved.