jedarden/pdftract
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
pdftract/notes
History
jedarden a601dcec76 feat(pdftract-2t9): implement regression corpus runner with CER gate 
Add regression-corpus step to pdftract-ci that runs the freshly-built
x86_64-unknown-linux-musl binary against a 500-PDF private regression
corpus stored in B2 (via ARMOR encrypted S3 proxy).

Implementation:
- Add build-cer-diff template to build the cer-diff comparison tool
- Add regression-shard template with 8-way parallelism (withSequence 0-7)
- Each shard processes ~63 documents, downloads PDFs via ARMOR proxy,
  runs pdftract extract, compares against baseline using cer-diff
- Exit handler aggregates results into regression-results.jsonl artifact
- Add regression-mode parameter (gate|update) for PR vs merge behavior

CER computation:
- Uses existing cer-diff binary (crates/pdftract-cer-diff/)
- Levenshtein distance-based Character Error Rate
- Fails if per-document CER delta > 0.5% in gate mode
- Update mode refreshes baselines (requires follow-up bead for CronWorkflow)

Infrastructure:
- ARMOR proxy endpoint: armor.armor.svc.cluster.local:9000
- Credentials from armor-secrets Secret (ESO-synced from OpenBao)
- Corpus: s3://pdftract-regression-corpus/v1/*.pdf
- Baselines: s3://pdftract-regression-corpus/baselines/<sha256>.json

Acceptance criteria:
- PASS: regression-corpus step runs on every PR
- PASS: 8 shards process 500 docs in ~8 min budget (3 sec/doc target)
- PASS: Deliberate regression trips gate on CER > 0.5%
- PASS: regression-results.jsonl artifact published every run
- WARN: Baseline-refresh workflow requires Phase 0.6.1 follow-up

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-18 01:17:58 -04:00
..
pdftract-1bn.md feat(pdftract-1bn): implement cross-compilation build matrix for 5 target triples 2026-05-18 00:06:55 -04:00
pdftract-1g87.md feat(pdftract-q15sh): implement v1 fingerprint algorithm 2026-05-18 01:02:30 -04:00
pdftract-1wqec.md docs(pdftract-1wqec): verify CI scaffolding acceptance criteria 2026-05-17 07:12:16 -04:00
pdftract-1yad.md fix(pdftract-1yad): enable proptest tests and update verification note 2026-05-18 00:15:00 -04:00
pdftract-2bpf6.md test(pdftract-2bpf6): add FlateDecode predictor tests and proptests 2026-05-18 01:08:21 -04:00
pdftract-2bsfc.md docs(pdftract-2bsfc): add verification note 2026-05-17 23:57:00 -04:00
pdftract-2t9.md feat(pdftract-2t9): implement regression corpus runner with CER gate 2026-05-18 01:17:58 -04:00
pdftract-3nnqy.md feat(pdftract-3nnqy): implement StreamDecoder trait, filter pipeline, and bomb limit 2026-05-18 00:34:28 -04:00
pdftract-4hn1.md feat(pdftract-4hn1): use Cow<'static, str> for diagnostic messages 2026-05-17 23:23:38 -04:00
pdftract-4iier.md docs(pdftract-4iier): complete per-profile README documentation 2026-05-18 00:32:06 -04:00
pdftract-4ymy.md docs(pdftract-4ymy): add verification note for indirect object parser 2026-05-18 01:08:39 -04:00
pdftract-5l9m.md docs(pdftract-5l9m): add CI validation script and verification note 2026-05-18 01:05:33 -04:00
pdftract-5tmcg.md test(pdftract-5tmcg): add cycle detection test for page tree flattener 2026-05-18 00:38:44 -04:00
pdftract-5z5d8.md fix(pdftract-5z5d8): fix provenance validation script 2026-05-17 23:43:37 -04:00
pdftract-7nav.md docs(pdftract-2bsfc): add verification note 2026-05-17 23:57:00 -04:00
pdftract-147a.md docs(pdftract-147a): author SDK contract specification 2026-05-17 23:13:55 -04:00
pdftract-1527.md test(pdftract-1527): add shared SDK conformance suite with 32 test cases 2026-05-18 01:17:42 -04:00
pdftract-q15sh.md feat(pdftract-q15sh): implement v1 fingerprint algorithm 2026-05-18 01:02:30 -04:00