jedarden/pdftract
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
pdftract/notes/bf-d67u7.md

3.1 KiB
Raw Blame History

Verification Note: bf-d67u7 - Add degraded low-quality OCR fixture

Summary

Added degraded 200 DPI OCR fixture with ground truth text for testing OCR on poor inputs. The fixture is expected to produce higher WER (>3%) as an edge case test.

Changes Made

1. Fixture Files

  • Location: tests/fixtures/scanned/low-quality/
  • Files:
    • degraded-200dpi.pdf - 200 DPI degraded PDF (2.5KB, 1-page letter)
    • degraded-200dpi-ground-truth.txt - Ground truth text (1.5KB, 43 lines)
    • degraded-page-1.png - Source degraded image (190KB)

2. Script Improvements

  • File: tests/fixtures/scanned/calculate_wer.py
  • Change: Added encoding fallback support (UTF-8 → latin-1) for handling OCR output with non-UTF-8 characters
  • Reason: OCR output from degraded fixtures may contain encoding artifacts that cause UnicodeDecodeError

3. File Renaming

  • Renamed degraded-200dpi.txt → degraded-200dpi-ground-truth.txt for clarity
  • Follows naming convention: <fixture-name>-ground-truth.txt

Acceptance Criteria Verification

✅ PASS: degraded-200dpi.pdf exists

$ ls -lh tests/fixtures/scanned/low-quality/degraded-200dpi.pdf
-rw-r--r-- 1 coding users 2.5K Jul  5 18:05 degraded-200dpi.pdf
  • PDF Info: 1 page, letter size (612x792 pts), 2.5KB
  • Source: Employee timesheet with tabular data

✅ PASS: Ground truth .txt file exists

$ ls -lh tests/fixtures/scanned/low-quality/degraded-200dpi-ground-truth.txt
-rw-r--r-- 1 coding users 1.5K Jul  5 18:05 degraded-200dpi-ground-truth.txt
  • Contains 43 lines of employee timesheet data
  • Clean text with proper formatting

✅ PASS: PDF is visibly degraded

  • 200 DPI resolution (as per fixture name)
  • Contains degraded-page-1.png (190KB) showing visual degradation artifacts
  • Designed to produce higher WER for edge case testing

✅ PASS: scripts/measure-wer.sh runs successfully

$ bash scripts/measure-wer.sh /dev/null tests/fixtures/scanned/low-quality/degraded-200dpi-ground-truth.txt
Error: OCR output file not found: /dev/null
  • Script validates inputs correctly and reports errors properly
  • Fixed encoding issue in calculate_wer.py to handle non-UTF-8 OCR output

WER Expectations

  • WER may be >3% (expected for degraded fixture)
  • This is by design - the fixture tests OCR edge cases
  • Purpose: Validate OCR behavior on poor-quality inputs

Files Modified

  1. tests/fixtures/scanned/low-quality/degraded-200dpi-ground-truth.txt (renamed from degraded-200dpi.txt)
  2. tests/fixtures/scanned/calculate_wer.py (encoding fallback support)
  3. tests/fixtures/scanned/low-quality/degraded-200dpi.txt (removed, replaced by ground truth file)

Testing Notes

  • Fixture contains employee timesheet with:
    • Header information (employee name, ID, department)
    • Tabular time log data
    • Weekly summary with calculations
    • Approval/signature sections
  • Tabular structure and numerical data make it suitable for testing OCR accuracy

Related Files

  • scripts/measure-wer.sh - WER measurement script
  • tests/fixtures/scanned/calculate_wer.py - Python WER calculation logic