History

jedarden 566cac2aea feat(pdftract-28m6): implement AGL compile-time phf::Map Add Adobe Glyph List (AGL) 1.4 and AGLFN 1.7 compile-time lookup using phf::Map. - Add generate_agl.py to parse AGL source files and generate agl.json - Add aglfn.txt (AGLFN 1.7, ~770 entries) and glyphlist.txt (AGL 1.4, ~4400 entries) - Add build.rs function to generate two phf::Map structures: - AGL: 4,200 single-codepoint entries - AGL_MULTI: 81 multi-codepoint entries (Hebrew/Arabic) - Add src/font/agl.rs with public API: - unicode_for_glyph_name() - handles algorithmic patterns (uniXXXX, uXXXXXX), variant stripping, AGL lookup - unicode_for_glyph_name_multi() - for multi-codepoint ligatures All 21 acceptance criteria tests pass. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>		2026-05-23 18:44:47 -04:00
..
build	feat(pdftract-28m6): implement AGL compile-time phf::Map	2026-05-23 18:44:47 -04:00
examples	feat(pdftract-mcp): add MCP server implementation changes	2026-05-23 03:09:56 -04:00
proptest-regressions/parser/lexer	feat(pdftract-29z7b): implement unified diagnostic system + CLI commands	2026-05-22 22:38:31 -04:00
src	feat(pdftract-28m6): implement AGL compile-time phf::Map	2026-05-23 18:44:47 -04:00
tests	test(pdftract-2zw): add reproducibility gate perturbation test	2026-05-23 15:04:05 -04:00
__test__.pdf	feat(pdftract-15pz8): implement multi-process safe cache operations	2026-05-23 05:31:11 -04:00
build.rs	feat(pdftract-28m6): implement AGL compile-time phf::Map	2026-05-23 18:44:47 -04:00
Cargo.toml	feat(pdftract-4my): implement pdfium-render path behind full-render feature	2026-05-23 16:28:08 -04:00
pdftract-core.cdx.json	feat(pdftract-67tm8): implement MCP stdio transport with integration tests	2026-05-23 00:16:42 -04:00
README.md	docs(pdftract-49f8): establish Cargo.lock policy and documentation	2026-05-20 18:13:14 -04:00

README.md

pdftract-core

The core Rust library for PDF text extraction. This crate provides the parsing, layout analysis, font encoding recovery, and text extraction primitives used by the CLI (pdftract-cli) and Python bindings (pdftract-py).

Cargo.lock Policy

This workspace checks in Cargo.lock at the repository root. This is unconventional for library crates—the Cargo Book historically suggested that only binary crates should check in lockfiles, allowing library consumers to resolve their own dependency versions.

pdftract departs from this convention for release reproducibility:

SLSA Level 3 provenance requires that every milestone tag produces byte-identical artifacts across builds. Without a checked-in lockfile, two runs of cargo build on the same commit can resolve different transitive dependency versions, producing different binary hashes.
Multi-output artifacts—this workspace produces Rust crates (pdftract-core, pdftract-cli), Python wheels (pdftract-py), and Docker images. All must be built from the same dependency tree.
Supply-chain security—the lockfile pins checksums for all transitive dependencies, enabling cargo audit to detect yanked or compromised crates.
Downstream consumers can still ignore the lockfile if needed. Cargo allows cargo build --frozen with a local lockfile override, or consumers can vendor the crate with their own dependency resolution.

The tradeoff—occasional merge conflicts when PRs update overlapping dependencies—is worth the guarantee of reproducible releases. See CONTRIBUTING.md for the lockfile-update workflow.

Modules

parser: PDF spec parsing (xref, trailer, object streams, indirect references)
font: Font encoding recovery, glyph name lookup, fingerprinting
layout: Page layout analysis, region segmentation, reading order
extract: Text extraction with provenance (bounding boxes, confidence scores)
ocr: Tesseract integration for raster pages

Usage

use pdftract_core::{extract_text, ExtractOptions};

let options = ExtractOptions::default();
let result = extract_text("document.pdf", &options)?;
println!("{}", result.text);