Get started with TestVibe
Create your first project, write a useful test, run it, and inspect the result.
What TestVibe does
- TestVibe keeps your test descriptions, executable tests, run history and evidence together in a project.
- Write a task in plain language, record browser steps, import a document, or work with existing test files. A first test can run with AI; generating Playwright code is a separate option.
- Your on-prem runners and browser services must reach the application under test. AI features use the model providers configured by your administrator.
Sign in and add your app
- Open your organization’s TestVibe address and sign in with your local account or configured identity provider. Ask your administrator for an invitation if signup is unavailable.
- On an unclaimed installation, the first signup creates the instance administrator without email verification and opens Settings → Administration. Complete that checklist first. Later signups follow the installation’s registration policy.
- Choose Add your app. The first-project dialog asks “What app would you like to test?” Enter the App URL that the runners can reach.
- TestVibe suggests a project name from the address. Expand Project details if you want to change it, then choose Continue. When adding another project, the action is Create project.
- Follow the first-test flow to check application access. Choose No sign-in needed, Use a test account, or saved sign-in steps where available. Test-account credentials are stored as project secrets; verify sign-in before continuing.
- The sidebar uses Tests for test files, Runs for execution history, Analytics for summaries, Application for application context, and Settings for project and workspace configuration.
Describe the test
- In the first-test flow, describe one task and its expected result, then choose Create and run test. You can also choose Record steps or Import document.
- For more tests, open Tests → New test. Markdown tests let you write steps and expected results in plain language; Gherkin uses Given, When and Then.
- Be specific about the starting state, test data, actions and visible result. Keep passwords in project secrets rather than in the test description.
- For example: “Sign in with the test account, create a customer named Alex, and check that Alex appears in the customer list.” This is more useful than “Test customers.”
- Review and save the test before reusing it in an automation. If a run could not start, open the saved test or retry it instead of creating a duplicate.
Generate Playwright code when needed
- You can run an editable plain-language test with AI or generate Playwright code for repeatable execution. Choose the path that fits your test.
- Generation uses the selected provider, model, application context and project settings. Ask an instance administrator to configure Model providers if no suitable model is available.
- Follow the progress shown with the test. Answer any request for missing information and review the resulting changes before relying on them.
- Keep the application URL, test account and relevant project notes current. A model must support the tools required by the chosen workflow; a reachable endpoint alone is not enough.
- Generated code is a draft to verify. Run it, inspect the evidence and improve the test when its assertions do not capture the intended behavior.
Run a test
- Open a saved test or select tests in the list and choose Run. Review the target environment and available browser or Playwright configuration before starting.
- Watch Runs for queued, active and completed work. AI runs show activity while the model and browser are working.
- If a run cannot start, read the displayed reason. Check runner availability, application access, required configuration, model credentials and license status as appropriate.
- Cancel work you no longer need and wait for its terminal status. Regeneration actions become available after active test runs finish.
Read the result
- Open the run and select the relevant test or step. Review its status, expected result and failure message before changing anything.
- Use the available screenshots, video, network and console evidence to understand what the browser actually did. Open the Playwright trace when the run provides one.
- Check whether the application failed, the test expected the wrong behavior, or the environment could not be reached. Authentication failures and missing test data often explain an otherwise unclear result.
- If artifact links fail while the run itself succeeded, ask your administrator to check the public Artifact URL and reverse-proxy configuration.
- Share the run through TestVibe’s sharing action so your teammate receives the relevant context.
Fix it and run again
- Correct the application when the evidence shows a product defect. Update the test when its instructions, assertions or data no longer describe the intended behavior.
- Use the editor’s assistance or the available run actions to investigate a failure. Review proposed changes before saving or applying them.
- Run the affected test again against the intended environment and compare its evidence with the previous run. A changed test should still check the original requirement.
- Keep useful application behavior and testing constraints in project notes so future work has the same context.
Where to go next
- Organize related tests into folders and use Automations when you are ready to schedule work or connect repository events.
- Configure environments, variables and secrets in Settings. Use Application and repository integration features when the assistant needs application context.
- Create an API key under Settings → CLI & API keys for your terminal or CI. Copy it when shown, store it securely, and follow the connection instructions displayed there.
- Instance administrators manage installation-wide email, identity providers, capacity, model providers and licensing under Settings → Administration.
- For installation problems, use the troubleshooting guide; for model setup, use AI providers and models.