Delayed or expired API test results, some delays in Gateway traffic display in Dashboard
All systems are operating normally. For a brief period of time this morning, a growing backlog of work to be processed caused a number of API test results to expire. Gateway traffic experienced a delay in showing up in Dashboard but continued to be relayed without incident. We deployed a fix and services began recovering immediately. API test results are no longer expiring, and Gateway traffic is being displayed without delay.
Jun 30, 09:19-10:48 PST
Disappearing test steps
All test data has been restored and tests are running on their normal schedules. We are reaching out to any customers that may be missing test step modifications made between 2:00pm PT / 21:00 UTC and 3:05pm PT / 22:05 UTC.
Jun 12, 15:26-17:43 PST
Test runs have been performing normally for the past 36 hours. Capacity and reliability improvements are ongoing. We will open a new incident if issues resurface. If you have any questions, please feel free to contact us at email@example.com
Apr 25, 12:11 - Apr 29, 08:58 PST
Slow running tests
All systems are fully operational. Radar tests are running on normal schedules across all regions. Ultimately we found that some Radar tests did not run between 1:15 AM and 1:38 AM Pacific time. You may see some missing or "expired" test runs during that time.
Apr 25, 01:32-02:13 PST
Slow running and expired tests
The issues have been resolved and the system has stabilized. The backlog of traffic was processed, and Radar traffic is available again in the Traffic Inspector. We are performing a full root cause analysis on the underlying issues and putting additional monitoring and infrastructure in place to reduce the likelihood of recurrences of this issue.
Apr 23, 09:37-14:52 PST
All systems are operational, Radar tests are running on normal schedules across all regions
Apr 20, 15:26-17:37 PST
Radar test run notification delays
Outbound Runscope Radar notifications have returned to normal volumes and are no longer delayed. We've added additional monitoring to our outbound notifications latency as well as put in place performance improvements to make sure that notifications are delivered in a timely manner.
Feb 11, 22:45 - Feb 12, 16:28 PST
Passageway Performance Issues
We've identified the source of performance problems with Passageway and have updated our infrastructure to resolve the issue.
Feb 11, 15:19-15:55 PST
Live Search Outage
Live Search indexes have been rebuilt for all of our customers. Custom Stream Views and Search Results should be working correctly for everyone now.
Jan 7, 15:40 - Jan 8, 12:33 PST
Radar Notification Emails
We have resolved the issue and Radar notification emails for new test runs will be sent. Please contact support (firstname.lastname@example.org) if you need further assistance.
Aug 26, 09:19-09:30 PST