Runs Momentic tests in the current project. By default, results are written to a local directory; passDocumentation Index
Fetch the complete documentation index at: https://momentic.ai/docs/llms.txt
Use this file to discover all available pages before exploring further.
--upload-results to send them to the dashboard after the
run completes. Requires tests to exist locally as YAML files.
Arguments
Tests to run, given as test file paths, directories, or test-name substrings.
Defaults to every test in the current project.
Common flags
Path to the Momentic configuration file. Defaults to
momentic.config.yaml in
the current directory.When using workspaces, load the project whose name
matches the filter.
Name to associate with this run, used in the dashboard and as the base
filename for generated reports.
Number of tests to run in parallel. Each test starts its own browser instance.
Number of times to retry a test if it fails. Overrides each test’s own retry
configuration.
Override the browser used for every test. Accepts
chromium, firefox, or
webkit. Takes precedence over the per-test and config defaults.Environment
Environment to run tests in. Overrides any environment configured on the test
itself. The base URL set on the test still takes precedence, use
--url-override to override it.Override the base URL of the test or environment. Useful for running against a
preview deployment.
Custom headers to include in the run. Specify multiple headers separated by
spaces.
CSV file containing input data for the tests. Each row is used as input for a
separate test run. See Data-driven
tests.
Filtering
Only run tests with one of the specified labels.
Only include tests whose file path matches any of the provided regex patterns.
The pattern only needs to match part of the path.
Exclude tests whose file path matches any of the provided regex patterns.
Quarantine
Skip quarantined tests entirely. By default, quarantined tests still run but
their statuses do not affect pipeline status or the process exit code.
Run only quarantined tests, applying their statuses to pipeline status and the
exit code.
Run every test and apply all statuses to pipeline status and exit code.
Caching
Disable step caches entirely. Steps run without cached data and no caches are
saved.
Always save updated step caches after successful runs, even on the main and
other protected Git branches. See cache saving
eligibility.
Run without using any existing caches. Step caches are still saved at the end
of the run. Useful for refreshing caches after a config change.
Bust the oldest
n% of step caches before the run. Useful for incrementally
regenerating caches after a config change. At least one cache is always
busted, even if n% rounds to zero. Only applies on non-protected branches.Video
Record videos of test runs. Accepts
true, false, or on-fail; the bare
flag is treated as true. Requires ffmpeg.Deprecated alias for
--video true. Use --video instead.Sharding
1-indexed shard to run. Combine with
--shard-count to split tests across
machines.Total number of shards.
Output
Directory to store run artifacts (screenshots, logs, results). The directory
is cleared at the start of a run. Defaults to
./test-results.Upload test results to the Momentic dashboard after the run. Equivalent to
running
momentic results upload <outputDir> once the run finishes.Output reporter. Pass multiple times to combine reporters
(e.g.
--reporter=list --reporter=junit).Live reporter renders progress to the terminal as the run unfolds:list— per-test rows. Default. On a TTY the running rows redraw in place with their current step; on non-TTY each test commits a single row when it finishes.
--reporter-dir:junitallureallure-jsonplaywright-jsonbuildkite-json
Directory where reporter output is saved. Defaults to
./reports. Filenames
derive from --name (or the project name).Update locally stored golden files for Visual diff steps. See Visual
testing.
Setup
Device pixel ratio of the local screen. Set to
2 on macOS Retina or other
HiDPI displays. Defaults to the detected screen DPR.Command to run before tests begin. Useful for booting a local dev server.
Resource to wait for before tests begin. Accepts anything supported by
wait-on.HTTP proxy used when polling
--wait-on. Provide the full URL including
protocol, optional credentials, host, and port.Timeout (in seconds) for
--wait-on. Defaults to 60. The run fails if the
resource is not reachable in time.CI
Maximum total run time, in minutes. When reached, running tests stop, results
are flushed to disk, and the process exits with code
1.Emit run diagnostics using standard OpenTelemetry exporter environment
variables. Configure exporter endpoints via the usual
OTEL_* env vars. Env:
MOMENTIC_SHARE_DIAGNOSTICS.Skip all confirmation prompts. Enabled by default when
CI is set.