The test
Keep it to the boundary: your app, into the vendor surface, far enough to prove the integration is alive, and back:tests/monitors/checkout-stripe.test.yaml
The workflow
The job installsmomentic from devDependencies, so your lockfile pins the
CLI version. Add it once with npm install -D momentic.
.github/workflows/monitor.yml
workflow_dispatch trigger is also your debug path).
Third-party fragility rules
- Their outage is your alert, not your test’s bug. A monitor failing because Stripe is down is the point. Route monitor failures to an on-call channel, separate from your PR-gate failures.
- Vendor UI drifts. Payment iframes change markup. Write natural-language targets (“the Card number field”) so locator auto-heal absorbs their redesigns.
- Do not retry into a charge.
--retriesis safe on read-only monitors; keep it off anything that mutates real state. Prefer vendor test modes. - Rate limits are real. Fifteen minutes is a reasonable floor; a flow that takes minutes to run should not run every minute. If you need tighter detection, monitor the vendor’s status endpoint with a plain HTTP check and keep Momentic for the end-to-end signal.