Product updates

Failure recovery (beta)

• Let Momentic automatically recover from certain failure scenarios.
• Review proposed steps in the run viewer and apply them directly to tests stored on Cloud or your local machine through a CLI command.
• Can be enabled on a per-test basis or globally in organization settings.

Test and suite cancellation

• Tests and suites running on Momentic Cloud can now be cancelled through the UI.
• Test cancellation may take 1-2 minutes to complete.

Usage statistics

• You can now view usage statistics for your organization on the settings page.
• This should help administrators track their credit usage and gauge differences in usage over time.

AI improvements

• We have developed a new v1 AI agents for locating elements and evaluating assertions that perform 17% better on our benchmarks.
• These agents should return more detailed thoughts and reasoning steps.
• We back-tested these agents extensively and followed a gradual rollout process in the last few weeks. v1 agents are now the default for all organizations.

Bug fixes

• Fix a bug where the PAGE_CHECK assertions would fail because fetching the HTML took too long.
• Improve the exponential backoff algorithm for PAGE_CHECK assertions, which sometimes led to lengthy pauses.
• Improve execution logic when running an individual step within a module; if all sub-steps of a module have been ran individually, the module as a whole is marked as complete now.
• Fix the logic for the “run to end” button when running a cached module.
• Reduce memory and CPU usage caused by streaming browser screenshots.
• Bump the max number of tokens that can be generated by AI agents for AI_ASSERTION steps.
• Create a randomized test ID when importing a new test via ZIP file into the cloud app.
• Restore the feature of test auto-saving on load in the editor.
• Fix rare cases of the Chrome browser hanging indefinitely due to an underlying Chromium bug.

New test tree view

• Click on a test in the tree view to view detailed information about the test. Including the steps, estimated credits, and included modules.
• Duplicate a test with a new name.
• Manually run tests against different environments.
• Delete a test directly from the tree view.
• Manage labels and suites directly from the test view.
• Schedule tests directly from the test view.
• Configure and customize notifications that you receive from Momentic. You can use variables and test data to make it more informative. Read more about it here.

Step updates

• Wait for URL now supports case insensitive matching and negative matching.
• AI check now support vision-only mode that is tuned for visual checks.
• A Module can now be treated as a auth module. This will automatically save and restore the state of the module. Turn on “Treat as auth module” to enable this feature.
• You can now use XY coordinates to target elements. This is useful when you want to click on a specific part of the screen.
• Pressing keys now supports a delay between each key press. This is useful when you want to simulate typing.
• Empty string is a valid value for the Type step.

Debug data

You can now see the HTML as well as the a11y tree in the editor and the test results. This will help you debug issues with your tests. We’ve also made updates to the console log and network logs viewers.

Suites

You can now set a default environment for a suite. This will be used when running tests in the suite.

Reporting

The CLI now supports outputting JUnit XML reports for test runs. You can use this to integrate with your CI/CD pipeline. Read more about it here.

Knowledge base

We now have a dedicated knowledge base for customers to share detailed guides and tutorials. You can access it here if you’re a current customer.

Performance

We’ve written an in-depth guide on Momentic’s performance characteristics. Check it out here.

Bug fixes

• Fixed a race condition when updating results.
• Locator redirection now works in shadow roots.
• Fixed concurrency issues with the Chromium browser in the CLI.
• Include IndexDB in saved and restored auth state.
• Updated mirror for stable channel Chrome.
• Improved table serialization.
• Updated File upload URL valiation.
• Retry failed email requests.
• Fixed drag and drop.
• Scroll now wait for the scroll to complete.
• Updated the create suite dialogs to support >35 tests at a time.
• Don’t throw an error if a click times out after completion.
• Make sure ungrouped steps have new ids.
• Support Node 18 in the CLI.
• Search will now preserve folders when searching.