Skip to main content

Run the Full Suite

Run the full suite when you want broad confidence across the generated tests in a project. Full-suite runs are best after individual tests and key groups are already stable.

Because this option may run many browser sessions, it can take longer and may surface shared setup issues such as unavailable test data, expired credentials, or plan capacity limits.

Before you start

Check the basics before launching a full suite:

CheckWhy it matters
A recent single test passedConfirms the target site, cloud test session, and configuration are working.
Key groups are stablePrevents one known setup issue from producing many noisy failures.
Credit balance is availableFull suites use more session time than focused runs.
Test data is readyShared accounts, seed data, and environment state affect many tests.
Secrets are currentExpired credentials can fail the whole run.

Start a full-suite run

  1. Open Runs.
  2. Select New Run.
  3. Select all runnable tests in the test list.
  4. Under Environment, pick the environment you want to validate (or a Custom URL).
  5. Choose one or more Run Configurations.
  6. Optionally set ExecutionSequential or a lower Custom cap reduces load on the target site during a large full-suite run, at the cost of a longer run; leave it on Auto otherwise.
  7. Start the run.

If your suite is organized into groups, you can select all groups or select the top-level suite entry when available. Review the selected tests before starting so the run matches the scope you intend.

When to use a full suite

Full-suite runs are helpful for:

SituationWhy it helps
Release readinessConfirms the main generated coverage passes before shipping.
Major UI changesCatches regressions across multiple feature areas.
Nightly validationGives the team a regular signal on the state of the app.
Environment checksConfirms staging or test deployments are usable end to end.

For recurring coverage, see Schedule runs.

Review failures

Start with the overall run status and then inspect failed rows. A full suite can produce related failures from a single root cause, so look for patterns before editing many tests.

Common examples:

PatternLikely next check
Many tests fail at sign-inCheck credentials, secrets, and login flow changes.
Failures start after a setup stepReview prerequisite steps and test data.
Only one group failsInvestigate that feature area first.
Only one browser or viewport failsReview the selected run configuration.

For evidence review, see Review Results.