This incident has been resolved.
Feb 19, 17:12 PST
The capacity improvements have stabilized the system and performance has been at normal levels for the past 40 minutes. We will continue to monitor for regressions in performance and update the status page as needed.
Feb 19, 15:35 PST
We have made some capacity adjustments which have helped minimize the slowness of tests starting and running, but we are continuing to investigate the root cause and determine a fix going forward. Test run throughput is currently back to normal levels, but may fluctuate as we continue work to fully resolve the issue.
Feb 19, 14:54 PST
We're investigating an issue causing diminished test run throughput (total test runs running at one time). Updates as we know more.
Feb 19, 14:34 PST