April 2025

Features

  • Improved accuracy of recording on lengthy sites.
  • Switch tab now accepts template strings.
  • Download HTML and Download A11y tree in the debug pane of the test editor.
  • New CLI option to ignore autogenerated href attributes.
  • Tests can now be duplicated directly from app

Bug fixes

  • React components that change classes no longer bust the cache.
  • Failure recovery no longer removes Element Check if they fail during a test.
  • Resolved an issue where scrolling in the browser preview or during Scroll steps did not match real-world behavior.
  • Fixed an issue that would sometimes cause the usage breakdown graph in Billing to not populate.
  • Changing the name of a module locally now updates the file name to match.
  • Addressed a compatibility issue where PostHog introduced a breaking change affecting users with Node.js versions 20.19.0 or older. Pinned and shrinkwrapped PostHog to version 4.15.0 to prevent future failures.
March 2025

Features

  • You can now upload files directly in Momentic. Use the File Upload step to upload files to your application during tests.
  • New search for modules in the editor.
  • Updated the repository’s tree structure to support arbitrary folder nesting, making it easier to organize your tests and modules.

Bug fixes

  • Uploading files larger than 5MB no longer causes a full-page error.
  • Element check now supports empty strings.
  • Assertions no longer cause elements to scroll into view.
  • Tests will no longer auto-save if validation errors are present.
  • Negative assertion results are no longer cached, ensuring accuracy.
  • Resolved navigation errors between multiple run attempts.
  • Local YAML test files will remain unchanged unless explicitly modified.
February 2025

Features

  • AI action has improved reasoning and self-healing capabilities.
  • Test runs with multiple attempts now allow viewing results for all attempts.
  • Momentic now displays Git information for CLI-executed tests.

Bug fixes

  • Momentic now correctly sets MIME types for uploaded files.
  • Fixed incorrect labeling of tests running on main branches as HEAD.
  • Suite-level environments now correctly override individual test environments.
  • Addressed an issue preventing removal or modification of scheduled tests.
  • npx momentic queue test no longer queues disabled tests.

Data retention policy updates

  • Screenshots and stop-level details will be kept for 3 months.
  • Run metadata will be kept for 6 months.
  • Analytics will be available indefinitely.
January 2025

Features

  • Analytics loads much faster and provides helpful insights to identify failing or flaky tests tests.
  • You can now view suite analytics, which aggregates analytics for all tests in a suite.
  • You can now view historical credit usage for suites and tests.
  • There are now steps in the editor for copy and pasting to and from the clipboard.
  • The editor now has a refresh button to refresh the page.
  • New buttons in the editor to move a step to the top or bottom of the test.
  • Suites now support setup and teardown.

Bug fixes

  • Enabled --headless=new on Chromium
  • AI action now supports interpolated variables.
  • Creating a new test when viewing a folder now adds it to that folder.
  • Selecting more than 40 tests per page when creating suites no longer breaks the dialog.
  • Test export now exports labels.
  • Duplicated tests are now created in the same folder as the original.
  • Accepting email invites no longer fails with 500 errors.
December 2024

Failure recovery (beta)

  • Review proposed steps in the run viewer and apply them directly to tests stored on Cloud or your local machine through a CLI command.
  • Can be enabled on a per-test basis or globally in organization settings.

Test and suite cancellation

  • Tests and suites running on Momentic Cloud can now be cancelled through the UI.

Usage statistics

  • You can now view usage statistics for your organization in settings.

AI improvements

  • We have developed a new v1 AI agents for locating elements and evaluating assertions that perform 17% better on our benchmarks.
  • These agents should return more detailed thoughts and reasoning steps.
  • We back-tested these agents extensively and followed a gradual rollout process in the last few weeks. v1 agents are now the default for all organizations.

Bug fixes

  • Fix a bug where the Page check assertions would fail because fetching the HTML took too long.
  • Improve the exponential backoff algorithm for Page check assertions, which sometimes led to lengthy pauses.
  • Improve execution logic when running an individual step within a module; if all sub-steps of a module have been ran individually, the module as a whole is marked as complete now.
  • Fix the logic for the “run to end” button when running a cached module.
  • Reduce memory and CPU usage caused by streaming browser screenshots.
  • Bump the max number of tokens that can be generated by AI agents for AI check steps.
  • Create a randomized test ID when importing a new test via ZIP file into the cloud app.
  • Restore the feature of test auto-saving on load in the editor.
  • Fix rare cases of the Chrome browser hanging indefinitely due to an underlying Chromium bug.
November 2024

New test tree view

  • Click on a test in the tree view to view detailed information about the test. Including the steps, estimated credits, and included modules.
  • Duplicate a test with a new name.
  • Manually run tests against different environments.
  • Delete a test directly from the tree view.
  • Manage labels and suites directly from the test view.
  • Schedule tests directly from the test view.
  • Configure and customize notifications that you receive from Momentic. You can use variables and test data to make it more informative.

Step updates

  • Wait for URL now supports case insensitive matching and negative matching.
  • AI check now support vision-only mode that is tuned for visual checks.
  • A module can now be treated as a auth module. This will automatically save and restore the state of the module. Turn on “Treat as auth module” to enable this feature.
  • You can now use XY coordinates to target elements. This is useful when you want to click on a specific part of the screen.
  • Pressing keys now supports a delay between each key press. This is useful when you want to simulate typing.
  • Empty string is a valid value for the Type step.

Debug data

You can now see the HTML as well as the a11y tree in the editor and the test results. This will help you debug issues with your tests. We’ve also made updates to the console log and network logs viewers.

Suites

You can now set a default environment for a suite. This will be used when running tests in the suite.

Reporting

The CLI now supports outputting JUnit XML reports for test runs. You can use this to integrate with your CI/CD pipeline.

Knowledge base

We now have a dedicated knowledge base for customers to share detailed guides and tutorials. You can access it here if you’re a current customer.

Performance

We’ve written an in-depth guide on Momentic’s performance characteristics. Check it out here.

Bug fixes

  • Fixed a race condition when updating results.
  • Locator redirection now works in shadow roots.
  • Fixed concurrency issues with the Chromium browser in the CLI.
  • Include IndexDB in saved and restored auth state.
  • Updated mirror for stable channel Chrome.
  • Improved table serialization.
  • Updated File upload URL validation.
  • Retry failed email requests.
  • Fixed drag and drop.
  • Scroll now wait for the scroll to complete.
  • Updated the create suite dialogs to support >35 tests at a time.
  • Don’t throw an error if a click times out after completion.
  • Make sure ungrouped steps have new ids.
  • Support Node 18 in the CLI.
  • Search will now preserve folders when searching.