Skip to content

Runs

Trigger tests, watch live progress, inspect results, cancel active work, and rerun from the CLI.

View as Markdown

A run is created whenever Smoketest executes a test. The CLI can start runs, watch live progress, inspect run details, cancel active work, and rerun a previous test.

Start a run

Shell
smoketest tests run "Homepage smoke test"
smoketest tests run "Homepage smoke test" --url https://preview-acme.vercel.app

The command prints the run ID, status, start URL, and dashboard links when available. Use --url to run against a preview or staging URL without changing the saved test.

To start one run for every test with a project tag:

Shell
smoketest tests run --project "Production" --tag Smoke
smoketest tests run --project "Production" --tag Smoke --url https://staging.acme.com

When a default project is set, --project can be omitted. Grouped tag runs apply --url to every matching test, print the created run IDs, and can be watched with smoketest runs watch <run>.

Watch live progress

Shell
smoketest tests run "Homepage smoke test" --watch

The live terminal view shows:

  • Run ID, test name, status, and elapsed time
  • A dashboard recording link
  • Completed agent actions
  • The current agent action
  • Final result and reasoning
  • Artifact, recording, transcript, and trace links when available

You can also attach to an existing run:

Shell
smoketest runs watch <run>

The dashboard link is useful when you want to watch or inspect the full browser recording in the web app.

List runs

Shell
smoketest runs list
smoketest runs list --project "Production"
smoketest runs list --test "Homepage smoke test"
smoketest runs list --status failed

Supported status filters are:

StatusMeaning
pendingQueued and waiting for an agent
runningAgent is currently using a browser
passedExpected outcome was verified
failedExpected outcome was not met
errorUnexpected execution error
cancelledRun was cancelled

Inspect a run

Shell
smoketest runs get <run>

Use a full run ID or the short ID shown in CLI tables.

Cancel a run

Shell
smoketest runs cancel <run>

The CLI asks for confirmation unless you pass:

Shell
smoketest runs cancel <run> --yes

Cancelling a queued run stops it before browser work starts. Cancelling a running run stops the active execution.

Rerun

Shell
smoketest runs rerun <run>
smoketest runs rerun <run> --watch
smoketest runs rerun <run> --url https://staging.acme.com

runs rerun starts a new run for the same test as the original run. If the previous run used a custom start URL, the rerun keeps it unless you pass a new --url.

JSON mode

For scripts, pass --json:

Shell
smoketest tests run "Homepage smoke test" --json
smoketest runs get <run> --json
smoketest runs list --status failed --json

JSON mode is non-interactive. It skips prompts, spinners, confirmations, and the live Ink UI.

On this page