jedarden/pdftract

Fork 0

Commit graph

Author	SHA1	Message	Date
jedarden	5cd0eac170	docs(pdftract-60h): update verification note with detailed acceptance criteria Updated the verification note with detailed acceptance criteria verification, including specific file locations and implementation details for the competitive benchmark infrastructure. Changes: - Added specific line references for CI workflow components - Detailed artifact output locations - Clarified WARN items (testing limitations) - Added infrastructure completeness notes All acceptance criteria: - ✅ PASS: bench-matrix step in CI DAG - ✅ PASS: benchmark-results.json artifact - ✅ PASS: Regression gate logic (10% threshold) - ✅ PASS: 10x-faster gate logic (vector PDFs) - ✅ PASS: PR commenter with 60s timeout - ⚠️ WARN: Tool timing requires pdftract binary Co-Authored-By: Claude Code <noreply@anthropic.com>	2026-05-18 01:27:15 -04:00
jedarden	857f928732	feat(pdftract-5omc): implement SDK conformance test runner pattern Implement the conformance test runner pattern that every SDK will implement to validate against the shared test suite. - Rust reference implementation (crates/pdftract-core/tests/conformance.rs) * Full test suite loader and executor * Comparison engine with min/max, string constraints, tolerances * Skip logic for unsupported features and schema versions * Report generation in JSON format - CLI compare subcommand (crates/pdftract-cli/src/main.rs) * pdftract compare - Compare actual vs expected with tolerances * Cross-language comparison tool to avoid reimplementations - Documentation (docs/conformance/sdk-contract.md) * Complete pattern specification with pseudocode * Per-language runner locations * CI integration requirements - Python reference stub (tests/python-conformance/test_conformance.py) * Full pytest-based implementation following the pattern Closes: pdftract-5omc	2026-05-18 01:22:23 -04:00

Author

SHA1

Message

Date

jedarden

5cd0eac170

docs(pdftract-60h): update verification note with detailed acceptance criteria

Updated the verification note with detailed acceptance criteria verification,
including specific file locations and implementation details for the competitive
benchmark infrastructure.

Changes:
- Added specific line references for CI workflow components
- Detailed artifact output locations
- Clarified WARN items (testing limitations)
- Added infrastructure completeness notes

All acceptance criteria:
- ✅ PASS: bench-matrix step in CI DAG
- ✅ PASS: benchmark-results.json artifact
- ✅ PASS: Regression gate logic (10% threshold)
- ✅ PASS: 10x-faster gate logic (vector PDFs)
- ✅ PASS: PR commenter with 60s timeout
- ⚠️ WARN: Tool timing requires pdftract binary

Co-Authored-By: Claude Code <noreply@anthropic.com>

2026-05-18 01:27:15 -04:00

jedarden

857f928732

feat(pdftract-5omc): implement SDK conformance test runner pattern

Implement the conformance test runner pattern that every SDK will
implement to validate against the shared test suite.

- Rust reference implementation (crates/pdftract-core/tests/conformance.rs)
  * Full test suite loader and executor
  * Comparison engine with min/max, string constraints, tolerances
  * Skip logic for unsupported features and schema versions
  * Report generation in JSON format

- CLI compare subcommand (crates/pdftract-cli/src/main.rs)
  * pdftract compare - Compare actual vs expected with tolerances
  * Cross-language comparison tool to avoid reimplementations

- Documentation (docs/conformance/sdk-contract.md)
  * Complete pattern specification with pseudocode
  * Per-language runner locations
  * CI integration requirements

- Python reference stub (tests/python-conformance/test_conformance.py)
  * Full pytest-based implementation following the pattern

Closes: pdftract-5omc

2026-05-18 01:22:23 -04:00

2 commits