TAMASH · RunSights

Every run.
One place. What changed.

Every Playwright and Cucumber run, from laptops and CI, as it happens. RunSights shows what newly failed, what got fixed, what is flaky, and the likely cause of each failure.

Included with Shield and Forge. Also on its own.

RunSights · Test healthmain · last 30 days
Newly failed3
Fixed5
Still failing1
Flaky2
  • checkout.spec.ts › the payment step opensNewly failed
  • account.spec.ts › order history lists the last orderFixed
  • checkout.spec.ts › a coupon code can be appliedFlaky
Three views

See the run.
Understand the change.

The local report tells one person how one run went. RunSights tells the team what every run means.

Runs
  1. RUN-1792401101CIGitHub Actions · main800
  2. RUN-1792401087CIGitHub Actions · PR 418620
  3. RUN-1792401080Localdana.whitfield711

Runs appear while they are still going. Shards of one CI build merge into one run. Filter by branch, environment, cycle or release.

Failure groups
  • Likely defect3 tests · 4 runsPay now button missing after the coupon step
  • Test1 test · 2 runsStrict mode: two rows match "Order 10342"
  • Setup5 tests · 1 runBrowser could not reach staging

The same failure across tests and runs is one group, with a likely cause and the evidence. Review it once.

Compare
RUN-1792401101 compared with RUN-1792401087
  • Fixedthe payment step opens
  • Fixeda coupon code can be applied
  • Newly failednone
Same 8 tests · 2 heals by Shield

Any run against the one before it: what a change fixed, broke or healed.

In your workflow

From every machine and pipeline.

On a laptop

A signed-in machine sends its runs under the person's name. An organization can collect CI runs only.

In CI

A service token for the pipeline. Traces, videos, screenshots and the Playwright HTML report are uploaded with the run and kept for 14 days.

With Forge

Runs of tests linked to Forge test cases count toward their cycles.

What is sent, and what stays

  • Sent: each test's result, duration, retries, the error and the source lines of a failed step, and the console output without colour codes, scanned for secrets.
  • Stays on the machine: the code around steps that passed, the values typed into fields, and the bytes of attachments from local runs.
  • Nothing in RunSights ever fails a test run. A portal that is slow or down is a line of output.
Works with

Playwright and Cucumber.js, locally and in CI.

Playwright Test

One line in the reporter list of playwright.config.ts. The local dashboard still writes next to your project for the person who ran it.

Cucumber.js

A formatter beside your console formatter. Each scenario is a test, each example row its own test, and the Playwright calls of each step are listed.

Your CI

GitHub Actions, GitLab CI, Azure Pipelines, Jenkins, CircleCI, Buildkite and Bitbucket are recognised from their variables: the run links back to the job that made it.

See your own runs in one place.

One line in your reporter list, and every run reaches the team.