Commit graph

4 commits

Author SHA1 Message Date
jedarden
9abc386cce feat(pdftract-3h9xo): implement threads JSON output + schema integration
Phase 7.7.3: Add threads field to ExtractionResult with ThreadJson schema integration.

Changes:
- Added ThreadJson and BeadJson structs to schema/mod.rs
- Added thread_to_json() function to threads/mod.rs
- Added build_page_ref_to_index() helper to parser/pages.rs
- Added threads field to ExtractionResult in extract.rs
- Implemented Phase 7.7 extraction logic with discover_threads/walk_beads
- Added threads_to_markdown() and collapse_page_ranges() to markdown.rs
- Updated JSON schema with ThreadJson and BeadJson definitions
- Added thread_to_py() and bead_to_py() conversions in pdftract-py
- Exported ThreadJson, BeadJson from lib.rs

All 32 threads module tests pass. All 35 markdown tests pass.

Verification: notes/pdftract-3h9xo.md

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-25 13:40:15 -04:00
jedarden
32350f8e81 feat(pdftract-55ihl): implement Otsu global thresholding for OCR preprocessing
Add otsu_binarize() function using imageproc::contrast::otsu_level and
threshold functions. Otsu method finds optimal global threshold by
maximizing inter-class variance between foreground and background.

Changes:
- Add imageproc 0.26 to Cargo.toml dependencies (ocr feature)
- Create crates/pdftract-core/src/ocr/preprocessing/otsu.rs module
- Export otsu_binarize from ocr::preprocessing and lib.rs
- Comprehensive tests: digital-origin images, binary output, uniform/tri-modal edge cases, text-like images, small images, benchmark

Acceptance criteria:
- Digital-origin (uniform-lit) page produces clean binary ✓
- Output pixels are exactly 0 or 255 ✓
- Benchmark: 1080p < 50ms (test provided, ignored by default) ✓
- Tri-modal histograms fail gracefully (no panic, still binary) ✓

Closes: pdftract-55ihl
2026-05-25 12:41:17 -04:00
jedarden
ff82fdce90 feat(pdftract-5xyjv): implement 3x3 median-filter denoising for OCR preprocessing
- Add median_denoise() function using imageproc::filter::median_filter
- 3x3 kernel (radius 1,1) removes salt-and-pepper noise while preserving edges
- Comprehensive tests: noise removal, edge preservation, binary output
- Export median_denoise from ocr::preprocessing module

Closes: pdftract-5xyjv
2026-05-24 16:09:08 -04:00
jedarden
61b94b49d2 feat(pdftract-6dki1): implement histogram stretch contrast normalization
Implement Phase 5.3.2a: histogram-based contrast normalization for OCR
preprocessing. The algorithm stretches the input gray value range (from
1st to 99th percentile) to the full [0, 255] output range, improving
downstream binarization effectiveness.

Key implementation details:
- 256-bin histogram computation for percentile calculation
- 1st/99th percentile robustness against hot pixels and artifacts
- In-place mutation for performance (no double allocation)
- Proper error handling for uniform images and invalid dimensions
- Overflow-safe arithmetic using i32 intermediate values

Acceptance criteria:
- Image with [50, 200] range → stretched to [0, 255]
- Hot pixel robustness: single 0/255 pixels handled correctly
- Uniform image → early return with UniformImage error
- Invalid dimensions (zero width/height) → InvalidDimensions error
- Full performance: < 50 ms for 8 MP images

Closes: pdftract-6dki1
2026-05-24 10:30:20 -04:00