Testing

Analytics & More

Track test performance, pass rates, scheduling, and notifications.

The analytics dashboard gives you visibility into your testing health across all repositories.

Dashboard Stats

The main testing dashboard shows four key metrics:

MetricDescription
Total TestsNumber of tests across all repositories
Pass RatePercentage of tests passing
Hours SavedEstimated manual testing time saved
Flaky TestsTests that pass sometimes, fail sometimes

Repository Health

The health visualization shows each repository as a bar:

my-frontend    ████████████░░░░  75% passing
my-backend     ████████████████  100% passing
my-api         ████░░░░░░░░░░░░  25% passing
  • Green = Passing tests
  • Red = Failing tests
  • Gray = Tests not run

Click any repository to drill down into its test details.

Track how your pass rate changes over time:

  • Daily pass rate percentage
  • Week-over-week comparison
  • Identify when regressions were introduced

Flaky Test Detection

A test is marked flaky when it:

  • Passes on some runs, fails on others
  • Has inconsistent results without code changes

Why Flaky Tests Matter

Flaky tests:

  • Waste time investigating false failures
  • Reduce trust in your test suite
  • Slow down development

Fixing Flaky Tests

CauseSolution
Race conditionsAdd explicit waits
Shared stateIsolate test data
Network timingMock external APIs
Animation timingWait for animations to complete
Random dataUse deterministic test data

Test Duration

See which tests are slow:

  • Average duration per test
  • Duration trends over time
  • Identify tests that have gotten slower

Slow tests increase feedback time and CI costs.


Run History

View aggregated statistics:

  • Total runs this week/month
  • Runs by trigger type (Manual, Scheduled, PR, Push)
  • Runs by platform (Chrome, Firefox, Safari)

Filtering Analytics

Filter analytics by:

  • Repository - Focus on one repo
  • Time range - Last 7 days, 30 days, 90 days
  • Test type - Unit, Integration, E2E, Performance

Exporting Data

Export analytics for reporting:

  1. Go to Testing > Analytics
  2. Set your filters
  3. Click Export
  4. Download as CSV

Notifications

Get notified when tests complete.

Enable Notifications

Go to Settings > Alerts and configure:

NotificationWhen It Fires
On FailureAny test fails
On FlakyA test is marked flaky
On SuccessAll tests pass (optional)
Suite CompleteAll scheduled tests finish

Notification Channels

ChannelDescription
EmailSend alerts directly to any email address
SlackPost to a Slack channel via incoming webhook
DiscordPost to a Discord channel via webhook
Microsoft TeamsPost to a Teams channel via connector webhook

Setting Up Integrations

  1. Go to Settings > Alerts
  2. Click Add Integration and select your platform
  3. Paste your webhook URL (or enter email address)
  4. Click Test to verify the connection

You can add multiple integrations. For example, send critical failures to Slack and a summary email to the team lead.


Best Practices

Review flaky tests weekly. A few flaky tests can erode trust in your entire suite.

Watch for pass rate drops after deployments—they indicate regressions.

Keep E2E tests under 30 seconds when possible. Long tests are more likely to be flaky.

Schedule tests during off-peak hours to avoid impacting staging environments.

Don't schedule destructive tests against production if they create test data or modify state.