Implemented the full SVG page renderer for the inspector debug viewer
(Phase 7.9.4). The renderer generates complete SVG documents with multiple
layers for visual debugging of PDF extraction results.
Changes:
- Implemented render_page_svg() with 10 layers (background, selection, 8 overlays)
- Added selection layer with invisible <text> elements for browser text selection
- Integrated all 8 overlay layer renderers (spans, blocks, columns, reading_order,
confidence_heatmap, ocr, mcid, anchors)
- Added arrowhead marker definition for reading order arrows
- Implemented helper functions: render_selection_layer(), render_ocr_layer(),
extract_columns_from_spans(), escape_xml_text()
- Added comprehensive unit tests for all functions
Acceptance criteria:
- ✅ Per-page SVG structure with proper viewBox and namespace
- ✅ 8 toggleable overlay layers with correct class names
- ✅ Color coding by confidence (spans) and kind (blocks)
- ✅ Coordinate system flip (PDF y-up to SVG y-down)
- ✅ Invisible <text> elements for browser text selection
- ✅ SVG determinism (same input produces identical output)
Deferred:
- Glyph paths via ttf-parser (requires font data not in JSON)
- Performance testing (requires full inspector integration)
- MCID layer (MCID tracking not in schema yet)
Closes: pdftract-4ct3y
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Phase 7.7.3: Add threads field to ExtractionResult with ThreadJson schema integration.
Changes:
- Added ThreadJson and BeadJson structs to schema/mod.rs
- Added thread_to_json() function to threads/mod.rs
- Added build_page_ref_to_index() helper to parser/pages.rs
- Added threads field to ExtractionResult in extract.rs
- Implemented Phase 7.7 extraction logic with discover_threads/walk_beads
- Added threads_to_markdown() and collapse_page_ranges() to markdown.rs
- Updated JSON schema with ThreadJson and BeadJson definitions
- Added thread_to_py() and bead_to_py() conversions in pdftract-py
- Exported ThreadJson, BeadJson from lib.rs
All 32 threads module tests pass. All 35 markdown tests pass.
Verification: notes/pdftract-3h9xo.md
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Implements the --audit-log FILE flag on serve, mcp --bind, and inspect subcommands.
Emits per-request NDJSON audit lines with ts, client_ip, tool, fingerprint, duration_ms,
status, and diagnostics fields. The AuditLogWriter wraps a BufWriter<File> behind a Mutex
and flushes after each line for crash safety.
Core changes:
- Added pdftract-core/src/audit.rs with AuditRecord schema and AuditLogWriter
- Added chrono dependency to pdftract-core/Cargo.toml for timestamp generation
- Added crates/pdftract-cli/src/middleware/audit.rs with axum middleware
- Integrated AuditState into ServeState, McpServerState, and InspectorState
- Added --audit-log flag to Serve, Mcp, and InspectArgs CLI structures
- Stdio MCP mode: audit goes to stderr (not stdout, which is JSON-RPC)
Acceptance criteria:
- pdftract serve --audit-log /var/log/pdftract.ndjson → per-request NDJSON lines appear
- Each line is single-line valid JSON (no embedded newlines in values)
- client_ip captured from X-Real-IP or X-Forwarded-For header
- Stdio MCP audit goes to stderr (with --audit-log /dev/stderr or implicitly)
- Concurrent requests: writes don't interleave (Mutex ensures atomic line writes)
- Crash mid-request: log line either fully present or fully absent (BufWriter flushes after each write)
Closes: pdftract-5boxq
Implement dashed vertical lines at column boundaries for debugging
Phase 4.4 column detection. Each column boundary uses a different
color from an 8-color palette with distinct dash patterns for left vs
right boundaries.
- Created render_columns() function in inspect/render/columns.rs
- CSS classes: column-boundary column-left/right for toggleability
- Data attributes: column-index, boundary, x0, x1 for UI consumption
- 10 unit tests covering all functionality
Also fixed pre-existing compilation errors in extract.rs and render
test files where SpanJson/BlockJson structs were missing required
fields (color, confidence_source, flags, rendering_mode, lang, spans).
Closes: pdftract-5bu2k
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Implements the render_anchors helper that draws block-id text labels at the
top-left corner of each block. Shows the Markdown anchor IDs that downstream
output (Phase 6.5 --md-anchors) will produce.
Key details:
- Function: render_anchors(page_index, page_number, blocks) -> Vec<String>
- Anchor ID format: p{page_number}-b{block_index} (e.g., "p1-b0")
- Text positioned at top-left corner (x0+2, y1-4) with small offset
- Data attributes: data-page-index, data-page-number, data-block-index,
data-bbox, data-kind
- CSS class: "anchor-label" for frontend toggleability
- Font: monospace, 10pt, black (#000000)
All 12 unit tests pass, covering empty input, single/multiple blocks,
positioning, bbox format, XML escaping, page variations, and SVG validity.
Closes: pdftract-5edjj
Implement the blocks layer renderer for the inspector debug viewer.
This renders translucent SVG rectangles for each structural block,
color-coded by block kind per plan §7.9.
Color encoding:
- heading: blue (#3b82f6)
- paragraph: gray (#9ca3af)
- table: teal (#14b8a6)
- list: purple (#a855f7)
- code: orange (#f97316)
- header/footer: light gray (#d1d5db)
- figure: brown (#a52a2a)
- caption: pink (#ec4899)
Each rect includes data-* attributes for tooltip consumption:
- data-kind, data-text, data-level, data-table-index, data-block-index
Also fix pre-existing missing `column` field in SpanJson test fixtures
across spans.rs and confidence_heatmap.rs.
Closes: pdftract-5iouh
Adds curved arrows between consecutive blocks in reading order with
numeric labels. Arrows use quadratic bezier curves with control points
at midpoint + 10pt downward. Limits to 50 arrows to prevent visual
clutter.
- Add render_reading_order function returning SVG path and text elements
- Include data-* attributes for tooltip consumption
- Add comprehensive unit tests (10/10 passing)
- Export reading_order module from inspect/render/mod.rs
Acceptance criteria:
- Helper compiles and produces valid SVG output ✅
- Layer is independently toggleable via CSS class ✅
- data-* attrs populated ✅
- Unit tests pass ✅
Closes: pdftract-6559n
Add render_confidence_heatmap() function that creates per-glyph
translucent colored cells representing extraction confidence.
Color coding:
- Red (#ef4444): confidence < 0.5 (low)
- Yellow (#eab308): 0.5 <= confidence < 0.8 (medium)
- Green (#22c55e): confidence >= 0.8 (high)
- Gray (#94a3b8): no confidence value (direct extraction)
Each cell includes data-* attributes (data-char, data-confidence,
data-span-index) for tooltip consumption by the frontend inspector
(Phase 7.9.6).
Implementation approximates per-glyph positions using span bbox
and character count, since the JSON schema only has span-level
confidence.
All unit tests pass. CSS class "heatmap-cell" enables frontend
toggling (Phase 7.9.3).
Closes: pdftract-67p2c
Implement per-word validation filter for assisted-OCR BrokenVector path.
Changes:
- Add SpanSource::OcrAssisted variant to hybrid.rs
- Add Span::ocr_assisted() helper method
- Implement validate_ocr_with_position_hints() in ocr.rs
- 5pt distance threshold for position validation
- 0.4 confidence cap for rejected words
- Linear scan for nearest-neighbor lookup
- Add unit tests for validation filter
Closes: pdftract-3s2i
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Add data-span-index attribute to span rectangles for click navigation
between SVG canvas and JSON-tree panel. Updated render_spans() to use
enumerate() for tracking indices. Added unit tests for index assignment.
Created demo HTML file demonstrating the full click navigation feature:
- Click span rect -> scroll JSON tree to matching entry
- Highlight target node with yellow background for 2 seconds
- Auto-open ancestor <details> elements
- Smooth scrollIntoView with center alignment
Acceptance criteria:
- PASS: data-span-index attribute added to all spans
- PASS: Click handler scrolls tree to matching node
- PASS: .highlighted class applied for 2 seconds
- PASS: Ancestor details auto-opened before scroll
- PASS: 9 unit tests pass including new span_index test
Closes: pdftract-saddv
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Implements the span layer renderer for the inspector debug viewer.
Renders SVG outline rectangles for each text span, color-coded by
extraction confidence. Red (< 0.5), yellow (0.5-0.8), and green (> 0.8)
indicate low, medium, and high confidence respectively. Gray indicates
direct extraction without OCR.
Each rect includes data-* attributes for tooltip and click consumption:
- data-text: the extracted text content (XML-escaped)
- data-confidence: confidence score or empty string
- data-font: font name (XML-escaped)
- data-size: font size in points
All 10 unit tests pass. The implementation follows the existing SVG
generation pattern in pdftract-core/src/receipts/svg.rs.
Closes: pdftract-p4vzu
