jedarden/pdftract
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
pdftract/tests/fixtures/ocr/brokenvector_aligned
History
jedarden 05be70d36f feat(pdftract-48ea): implement BrokenVector fixtures + WER delta CI gate 
Add two PDF/A fixtures for testing assisted-OCR (BrokenVector path):
- Aligned fixture with correctly-positioned invisible text layer
- Misaligned fixture with text layer offset by (10pt, 5pt)

Extend ci/wer-gate.sh with WER validation for BrokenVector fixtures.

Acceptance criteria:
- Two BrokenVector fixtures committed (both 1.5 KB, well under 200 KB limit)
- ci/wer-gate.sh extended with new fixture invocations
- WER delta tests will skip gracefully when OCR environment unavailable

Closes: pdftract-48ea

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-24 10:52:41 -04:00
..
ground_truth.txt feat(pdftract-48ea): implement BrokenVector fixtures + WER delta CI gate 2026-05-24 10:52:41 -04:00
README.md feat(pdftract-48ea): implement BrokenVector fixtures + WER delta CI gate 2026-05-24 10:52:41 -04:00
source.pdf feat(pdftract-48ea): implement BrokenVector fixtures + WER delta CI gate 2026-05-24 10:52:41 -04:00

README.md

BrokenVector Aligned Fixture

This fixture tests the assisted-OCR path with a correctly-positioned invisible text layer.

Fixture Properties

  • Page class: BrokenVector
  • Text layer: Invisible (Tr=3) text at correct positions
  • Ground truth: Accurate text content from the scan
  • Expected behavior: Assisted OCR should outperform blind OCR (WER delta < -1%)

Generating source.pdf

This fixture is generated using the generate_brokenvector_fixtures.py script in the parent directory:

cd tests/fixtures/ocr
python generate_brokenvector_fixtures.py

The script:

  1. Creates a clean text scan of Lorem Ipsum at 300 DPI
  2. Embeds an invisible text layer (Tr=3) at the correct glyph positions
  3. Outputs a PDF/A-1b compliant file

Expected WER Delta

  • Blind OCR WER: ~2-3% (baseline without position hints)
  • Assisted OCR WER: < 1% (with position validation)
  • Delta: Assisted should be at least 1% better than blind

Test Coverage

This fixture validates:

  • Position validation filter accepts correctly-aligned words
  • Assisted OCR produces better results than blind OCR
  • WER delta gate detects regression when validation filter is disabled