How AI Generation Works

Understand the generation lifecycle from saved test intent to generated Playwright output.

AI generation is the bridge between readable test intent and executable Playwright automation.

TestVibe starts the work from the app, runs it in an isolated cloud session, and shows progress as the session reports back.

The Short Version

1. You select or create a feature in the Test Suite.

2. You start generation and confirm the site URL or options.

3. TestVibe starts a cloud test session.

4. The selected AI agent works from your feature intent and target site.

5. TestVibe shows live progress, sections, steps, screenshots, and status.

6. Generated files are saved to your project.

7. You review the output and run the test.

Generation Inputs

Generation uses several pieces of context:

Input	Why it matters
Feature intent	The Gherkin or test description tells the agent what behavior to create.
Target site URL	The agent and generated test need to know which application to use.
Website framework	Framework context helps the agent understand app patterns.
Reasoning effort	Set in Settings → AI Model. Controls how thorough generation is and how many credits it uses.
Project settings	Gives generation access to paths, secrets, and variables.
Existing test files	Helps generation fit the project's current structure and style.

Generation Outputs

Generation can produce or update:

Output	What it is
Feature file	The .feature file that describes the test intent.
Playwright code	The executable Playwright .spec.ts test file.
Progress details	Section and step status shown while generation runs.
Screenshots or preview	Visual evidence captured while the agent works.
Run links	Links to run details or generated output when available.

Live Progress

The generation view can show:

• an overview of the full generation run

• background, scenario, and scenario outline sections

• authored or generated steps

• section status such as queued, running, finalizing, or failed

• live preview screenshots when available

• links to run details, target site, generated paths, or traces

Generation can pause to ask you a question mid-run, which you answer in the drawer.

See Review generation progress.

Where Files Are Saved

Generated output is saved to your project. Feature files usually live under Features/, and generated Playwright code is stored beside or near the feature it belongs to.

For file management details, see Manage generated test files.

What To Do After Generation

After generation succeeds:

1. Read the generated output.

2. Confirm it matches the intended behavior.

3. Run one test before running a full group.

4. Use results to decide whether to keep, edit, or regenerate.

If generation fails, open the generation details first. The failure may be setup-related rather than a problem with the feature itself.