Evidence Bundles

An evidence bundle is a machine-readable test report for one exact governed artifact. It records the rule identity, compiler version, artifact hash, and the hashed input, output, and expectation for every case.

Define golden cases

Place cases beside the rule as <rule>.cases.json, or pass another file with --cases:

[
  {
    "name": "conforming DTI",
    "input": { "income": 6000, "debt": 1800 },
    "expected": true
  },
  {
    "name": "over threshold",
    "input": { "income": 3000, "debt": 1500 },
    "expected": false
  }
]

expected is compared with the rule’s Respond with value.

Generate and verify

devlish evidence credit_dti.dvl --output evidence.json
devlish evidence --verify evidence.json

Generation compiles once and runs every case against that exact artifact. It exits non-zero when any case fails. Verification recomputes the report digest and rejects an altered report.

The bundle includes:

• governed rule id and version
• artifact_sha256 and compiler version
• pass/fail totals
• per-case input, output, and expected-value hashes
• report_sha256 over the canonical report

The controlled release workflow records the evidence report hash and refuses to propose a version whose cases fail.