jedarden/pdftract

Fork 0

Commit graph

Author	SHA1	Message	Date
jedarden	c622e3a6b7	feat(bf-3gewx): create WER measurement script Create scripts/measure-wer.sh that computes Word Error Rate between OCR output and ground truth text. Features: - Takes two arguments: <ocr_output_file> and <ground_truth_file> - Computes WER using formula: (substitutions + insertions + deletions) / total_words - Exit code 0 if WER ≤ 3%, otherwise exit code 1 - Includes --help for usage information - Supports VERBOSE=1 for detailed output Acceptance criteria verified: - ✓ Script exists and is executable - ✓ Identical inputs: WER = 0.00%, exit code 0 - ✓ 10% substitutions: WER = 11.11%, exit code 1 - ✓ --help shows usage Closes bf-3gewx	2026-07-05 14:31:51 -04:00
jedarden	a0c3ebb237	feat(bf-5for4): design manifest schema for grep-corpus - Add manifest.csv with header row: filename,source_url,page_count,file_size,checksum,license - Update README.md with comprehensive schema documentation and field descriptions - Schema supports provenance tracking, integrity verification, and license compliance Closes bf-5for4	2026-07-05 12:21:25 -04:00

Author

SHA1

Message

Date

jedarden

c622e3a6b7

feat(bf-3gewx): create WER measurement script

Create scripts/measure-wer.sh that computes Word Error Rate between OCR output and ground truth text.

Features:
- Takes two arguments: <ocr_output_file> and <ground_truth_file>
- Computes WER using formula: (substitutions + insertions + deletions) / total_words
- Exit code 0 if WER ≤ 3%, otherwise exit code 1
- Includes --help for usage information
- Supports VERBOSE=1 for detailed output

Acceptance criteria verified:
- ✓ Script exists and is executable
- ✓ Identical inputs: WER = 0.00%, exit code 0
- ✓ 10% substitutions: WER = 11.11%, exit code 1
- ✓ --help shows usage

Closes bf-3gewx

2026-07-05 14:31:51 -04:00

jedarden

a0c3ebb237

feat(bf-5for4): design manifest schema for grep-corpus

- Add manifest.csv with header row: filename,source_url,page_count,file_size,checksum,license
- Update README.md with comprehensive schema documentation and field descriptions
- Schema supports provenance tracking, integrity verification, and license compliance

Closes bf-5for4

2026-07-05 12:21:25 -04:00

2 commits