Skip to content

Statuses and exit codes

StatusBaseHeadMeaning
provenAssertion failurePassThe changed test distinguishes the patch.
not_provenPassPassThe test already passed before the patch.
still_failingAssertion failureAssertion failureThe implementation does not satisfy the test.
inconclusiveInfrastructure uncertaintyAnyPatchProof cannot make a trustworthy claim.
no_testsNo eligible changed test was selected.

Suite comparison can additionally report healthy, improved, pre_existing_failure, regression, or inconclusive.

The CLI uses stable nonzero exit codes for policy-relevant outcomes. See the CLI reference for the exact mapping.

The central safety invariant is:

A timeout, crash, import error, setup failure, collection failure, or unknown runner output can never become proven.

Deterministic regression-test evidence. No telemetry or required AI.