Run Tests

Run Tests

Two test entrypoints:

• bin/test.ps1 — unified test orchestrator for the Browser4 monorepo. Supports Maven tests, Rust CLI tests, PowerShell *.tests.ps1 files, real-world scenario agent evaluations, and mock-server launch.

• bin/test-production.ps1 — acceptance test for the latest production release of browser4-cli. Downloads, installs, exercises, uninstalls, and re-installs the global CLI from the public OSS distribution channel.

When to Use

• "run the tests"
• "run fast / unit tests"
• "run integration / it tests"
• "run e2e tests"
• "run cli tests"
• "run all PowerShell tests"
• "run real-world scenarios"
• "check what tests would run" (-DryRun / -Show)
• "resume failed tests"
• "launch mock server"
• "run production acceptance test"
• "acceptance test the latest release"

How It Works

bin/test.ps1 buckets test-type arguments into dispatch categories (Maven, CLI, PowerShell, RWS, server) and runs each in sequence. The script must be invoked from the repository root (it Set-Locations there automatically).

Test results are persisted per invocation to .test-sessions/<session-id>/test-session.json (see bin/common/test-session.psm1). Pass -NoSession to skip persistence or -SessionPath to write to a custom location.

Usage

bashCopy code
./bin/test.ps1 [OPTIONS] [TEST-TYPES...] [EXTRA-ARGS...]

Options

Test Types

RWS Flags (accepted after rws)

Examples

bashCopy code
# Run fast unit tests
./bin/test.ps1 fast

# Show the Maven command without executing
./bin/test.ps1 -DryRun fast

# Run integration tests with extra Maven args
./bin/test.ps1 it -pl browser4-core

# Run end-to-end tests
./bin/test.ps1 e2e

# Run CLI tests (Rust cargo test)
./bin/test.ps1 cli

# Pass extra cargo test args to CLI tests
./bin/test.ps1 cli -- --help

# Run all PowerShell test files (+ the skills/ document conformance check)
./bin/test.ps1 ps

# Run all PS tests quietly
./bin/test.ps1 ps -Quiet

# Run all main tests together
./bin/test.ps1 main

# Run fast tests and PS tests together
./bin/test.ps1 fast ps

# Run fast tests without persisting session
./bin/test.ps1 -NoSession fast

# Write session to a custom path
./bin/test.ps1 -SessionPath out/session.json ps

# Preview what tests would be run
./bin/test.ps1 -Show main

# Resume from the last failed Maven module
./bin/test.ps1 resume

# Launch the mock server
./bin/test.ps1 mock-site -Dmock.site.port=18080

# Run all real-world scenarios
./bin/test.ps1 rws --scenarios

# Run a specific scenario
./bin/test.ps1 rws --scenarios amazon

# Run scenarios against installed production CLI
./bin/test.ps1 rws --scenarios --production

# List discovered scenarios
./bin/test.ps1 rws --scenarios --list

# Run a single task file directly
./bin/test.ps1 rws --task tasks/real-world/generic/amazon.md

# Run scenarios with 30-minute per-task timeout
./bin/test.ps1 rws --scenarios --timeout 30

Test Session

After each invocation, results are persisted to .test-sessions/<session-id>/test-session.json. To inspect the latest session:

bashCopy code
ls -t .test-sessions/*/test-session.json | head -1 | xargs cat

The session records the last status, log paths, per-file results (for ps), system environment, and a rolling 5-entry history per test type. Pass -NoSession to skip persistence, or -SessionPath <path> to write to a custom location.

Production Acceptance Test

bin/test-production.ps1 simulates a real end user's journey with the published browser4-cli release. It is designed to be run in CI or locally before tagging a release.

Safe default

Running with no arguments shows help (safe default):

bashCopy code
./bin/test-production.ps1

Options

What it tests

1. Creates an isolated working directory (default: system temp + random suffix)
2. Cleans any pre-existing global browser4-cli installation
3. Installs the latest CLI via the remote bootstrap script (unmodified)
4. Verifies the CLI is on PATH after install (fails if the install script is broken)
5. Smoke-tests: --help, --version, config --help, agent-run --help, invalid command
6. Cold-starts the browser server (open), verifies health endpoint responds
7. Measures warm-start latency vs cold-start (cycle 2)
8. Shuts down the server (close-all, kill-all), verifies it's unreachable
9. Uninstalls and verifies runtime data is removed
10. Repeats the install cycle to verify idempotency
11. (With -Stress) Runs multi-scenarios.ps1 against the global CLI

Key principle

The script acts like a real end user — it does not patch install scripts, create missing symlinks, or manually clean up after uninstall. If any of those are needed, the test fails because a real user would hit the same broken behavior.

Examples

bashCopy code
# Show help (no arguments = safe default)
./bin/test-production.ps1

# Run the full acceptance test
./bin/test-production.ps1 -Stress

# Production CI: stress test with multiple iterations, clean up afterward
./bin/test-production.ps1 -Stress -MultiScenariosIterations 3 -RemoveWorkingDir

# Use a specific working directory
./bin/test-production.ps1 -WorkingDir /tmp/my-acceptance-test