Push run results to New Relic

The newrelic reporter pushes run results to the New Relic Event API. The reporter sends each test run as a MomenticRun custom event and each run group as a MomenticRunGroup summary event. Query both with New Relic Query Language (NRQL).

1. Configure the reporter

Add a reporting.newrelic block to momentic.config.yaml:

momentic.config.yaml

name: my-project

reporting:
  newrelic:
    region: US # or EU, selects the ingest endpoint
    accountId: "1234567"
    licenseKey: ${NEW_RELIC_LICENSE_KEY}
    attributes: # optional static tags added to every event
      service: checkout
      team: payments

region defaults to US. Use EU for accounts in New Relic’s EU data center.
licenseKey is optional. If omitted, the reporter reads the NEW_RELIC_LICENSE_KEY environment variable. Use an ingest license key.
attributes adds static tags (e.g. service, team) to every event, useful when multiple projects report into the same account.
accountId, licenseKey, and attributes values all support ${ENV_VAR} interpolation.

2. Run with the New Relic reporter

Pass --reporter newrelic to momentic run:

npx momentic run --reporter newrelic

Pass --reporter multiple times to combine reporters:

npx momentic run --reporter newrelic --reporter junit --reporter-dir reports

3. Event reference

The reporter sends MomenticRun once per executed test:

Attribute	Description
`runId`, `runGroupId`	Momentic run and run group identifiers
`testId`, `testName`, `filePath`	Test identity
`status`	`PASSED`, `FAILED`, or `CANCELLED`
`startedAt`, `finishedAt`, `durationMs`	Timing
`attempts`, `quarantined`, `recovered`	Retry and quarantine state
`labels`	Comma-separated test labels
`environment`, `baseUrl`	Environment the test ran against
`failureReason`, `failureMessage`	Failure details (failed runs only)
`classificationCategory`	AI failure classification category
`classificationReasoning`	AI failure classification explanation
`runUrl`	Link to the run in the Momentic dashboard
`gitBranch`, `gitCommit`, `gitRepository`	Git metadata
`ciRunUrl`	CI build link (GitHub Actions, GitLab, Buildkite, CircleCI)

The reporter sends MomenticRunGroup once per run as a summary:

Attribute	Description
`runGroupId`, `runGroupUrl`	Run group identity and link
`total`, `executed`, `skipped`, `passed`, `failed`, `cancelled`, `quarantined`, `recovered`	Result counts
`passRate`	`passed / executed`
`startedAt`, `finishedAt`, `durationMs`	Timing
`environment`, `suiteName`, git and CI attributes	Shared context

The reporter adds custom attributes from the config to both event types.

4. Query in New Relic

Pass rate per test over the last day:

SELECT
  percentage (
    count(*),
    WHERE
      status = 'PASSED'
  )
FROM
  MomenticRun FACET testName SINCE 1 day ago

Alert on run group pass rate:

SELECT
  latest (passRate)
FROM
  MomenticRunGroup
WHERE
  environment = 'production'

Overview

Migrate to Momentic

Frameworks

Use cases

Triage

AI actions

Authentication

Page interactions

Test data & variants

Visual testing

Reporting

Upgrading

Push run results to New Relic

1. Configure the reporter

2. Run with the New Relic reporter

3. Event reference

4. Query in New Relic

​1. Configure the reporter

​2. Run with the New Relic reporter

​3. Event reference

​4. Query in New Relic

​Related

1. Configure the reporter

2. Run with the New Relic reporter

3. Event reference

4. Query in New Relic

Related