Commit graph

12 commits

Author SHA1 Message Date
jedarden
1cf026ace7 feat(pdftract-4z362): implement inspector API endpoints
- Added api.rs module with handlers for /api/document, /api/page/{i}, /api/page/{i}/svg,
  /api/page/{i}/thumbnail, /api/raster/{i}.png, and /api/search
- Implemented Bearer token authentication for non-loopback binds
- Added base64 dependency for raster PNG decoding
- Returns 404 for /api/raster on vector pages (no raster field)
- Search performs case-insensitive substring matching across all spans
- SVG rendering is placeholder pending full renderer integration

Closes: pdftract-4z362
2026-05-25 12:56:01 -04:00
jedarden
b0c103b44f feat(pdftract-5boxq): implement audit-log FILE flag with NDJSON writer + middleware
Implements the --audit-log FILE flag on serve, mcp --bind, and inspect subcommands.
Emits per-request NDJSON audit lines with ts, client_ip, tool, fingerprint, duration_ms,
status, and diagnostics fields. The AuditLogWriter wraps a BufWriter<File> behind a Mutex
and flushes after each line for crash safety.

Core changes:
- Added pdftract-core/src/audit.rs with AuditRecord schema and AuditLogWriter
- Added chrono dependency to pdftract-core/Cargo.toml for timestamp generation
- Added crates/pdftract-cli/src/middleware/audit.rs with axum middleware
- Integrated AuditState into ServeState, McpServerState, and InspectorState
- Added --audit-log flag to Serve, Mcp, and InspectArgs CLI structures
- Stdio MCP mode: audit goes to stderr (not stdout, which is JSON-RPC)

Acceptance criteria:
- pdftract serve --audit-log /var/log/pdftract.ndjson → per-request NDJSON lines appear
- Each line is single-line valid JSON (no embedded newlines in values)
- client_ip captured from X-Real-IP or X-Forwarded-For header
- Stdio MCP audit goes to stderr (with --audit-log /dev/stderr or implicitly)
- Concurrent requests: writes don't interleave (Mutex ensures atomic line writes)
- Crash mid-request: log line either fully present or fully absent (BufWriter flushes after each write)

Closes: pdftract-5boxq
2026-05-25 05:14:06 -04:00
jedarden
3d04ca5f6f feat(pdftract-5bu2k): implement render_columns inspector layer renderer
Implement dashed vertical lines at column boundaries for debugging
Phase 4.4 column detection. Each column boundary uses a different
color from an 8-color palette with distinct dash patterns for left vs
right boundaries.

- Created render_columns() function in inspect/render/columns.rs
- CSS classes: column-boundary column-left/right for toggleability
- Data attributes: column-index, boundary, x0, x1 for UI consumption
- 10 unit tests covering all functionality

Also fixed pre-existing compilation errors in extract.rs and render
test files where SpanJson/BlockJson structs were missing required
fields (color, confidence_source, flags, rendering_mode, lang, spans).

Closes: pdftract-5bu2k

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-25 04:52:46 -04:00
jedarden
cdf112a300 feat(pdftract-5edjj): implement render_anchors inspector layer renderer
Implements the render_anchors helper that draws block-id text labels at the
top-left corner of each block. Shows the Markdown anchor IDs that downstream
output (Phase 6.5 --md-anchors) will produce.

Key details:
- Function: render_anchors(page_index, page_number, blocks) -> Vec<String>
- Anchor ID format: p{page_number}-b{block_index} (e.g., "p1-b0")
- Text positioned at top-left corner (x0+2, y1-4) with small offset
- Data attributes: data-page-index, data-page-number, data-block-index,
  data-bbox, data-kind
- CSS class: "anchor-label" for frontend toggleability
- Font: monospace, 10pt, black (#000000)

All 12 unit tests pass, covering empty input, single/multiple blocks,
positioning, bbox format, XML escaping, page variations, and SVG validity.

Closes: pdftract-5edjj
2026-05-25 03:16:07 -04:00
jedarden
ce7960b39a feat(pdftract-5iouh): implement render_blocks layer renderer
Implement the blocks layer renderer for the inspector debug viewer.
This renders translucent SVG rectangles for each structural block,
color-coded by block kind per plan §7.9.

Color encoding:
- heading: blue (#3b82f6)
- paragraph: gray (#9ca3af)
- table: teal (#14b8a6)
- list: purple (#a855f7)
- code: orange (#f97316)
- header/footer: light gray (#d1d5db)
- figure: brown (#a52a2a)
- caption: pink (#ec4899)

Each rect includes data-* attributes for tooltip consumption:
- data-kind, data-text, data-level, data-table-index, data-block-index

Also fix pre-existing missing `column` field in SpanJson test fixtures
across spans.rs and confidence_heatmap.rs.

Closes: pdftract-5iouh
2026-05-25 02:27:24 -04:00
jedarden
e9bd5b2b58 feat(pdftract-5pbkp): implement inspect subcommand with clap parsing and axum server
Add inspect subcommand structure with:
- InspectArgs struct with clap parsing (file, port, bind, no_open, auth_token, compare)
- Validation: non-loopback bind requires auth-token, file existence checks
- Extraction pipeline integration (extract_pdf -> result_to_json)
- InspectorState for caching extraction results
- Axum router with placeholder index handler
- Browser launcher with platform detection (Linux/macOS/Windows)
- Ctrl-C handling via tokio::signal

Acceptance criteria PASS:
- Default invocation binds to 127.0.0.1:7676
- --no-open suppresses browser launcher
- Non-loopback bind without --auth-token -> validation error
- GET / returns 200 with placeholder HTML
- cargo check/clippy/fmt pass

WARN: Full integration test blocked by pre-existing classify.rs bug
(out of scope for this bead).

Closes: pdftract-5pbkp
Co-Authored-By: Claude Code <claude@anthropic.com>
2026-05-24 17:13:05 -04:00
jedarden
cce26bb6b6 feat(pdftract-64j83): implement column label assignment to Span.column + Line.column
- Add column: Option<u32> field to Span in hybrid.rs
- Create layout/columns.rs module with:
  - Column struct (index + x_range)
  - assign_columns_to_spans() - assign by x_range containing bbox[0]
  - assign_columns_to_lines() - propagate via mode (>50% dominance)
  - HasBBoxAndColumn and HasSpansWithColumn traits
- Update layout/mod.rs to export column types
- Fix test fixtures in inspect/render (add column: None)

Acceptance criteria:
- 2-column page span at x0=50 -> Some(0), x0=350 -> Some(1)
- Full-width heading line -> None (mixed spans)
- Single-column page -> all spans Some(0)
- Inter-column gap -> None

Closes: pdftract-64j83

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-24 14:45:19 -04:00
jedarden
41d9ca6e01 feat(pdftract-6559n): implement render_reading_order inspector layer
Adds curved arrows between consecutive blocks in reading order with
numeric labels. Arrows use quadratic bezier curves with control points
at midpoint + 10pt downward. Limits to 50 arrows to prevent visual
clutter.

- Add render_reading_order function returning SVG path and text elements
- Include data-* attributes for tooltip consumption
- Add comprehensive unit tests (10/10 passing)
- Export reading_order module from inspect/render/mod.rs

Acceptance criteria:
- Helper compiles and produces valid SVG output 
- Layer is independently toggleable via CSS class 
- data-* attrs populated 
- Unit tests pass 

Closes: pdftract-6559n
2026-05-24 11:50:05 -04:00
jedarden
6ffeccc26e feat(pdftract-67p2c): implement confidence heatmap layer renderer
Add render_confidence_heatmap() function that creates per-glyph
translucent colored cells representing extraction confidence.

Color coding:
- Red (#ef4444): confidence < 0.5 (low)
- Yellow (#eab308): 0.5 <= confidence < 0.8 (medium)
- Green (#22c55e): confidence >= 0.8 (high)
- Gray (#94a3b8): no confidence value (direct extraction)

Each cell includes data-* attributes (data-char, data-confidence,
data-span-index) for tooltip consumption by the frontend inspector
(Phase 7.9.6).

Implementation approximates per-glyph positions using span bbox
and character count, since the JSON schema only has span-level
confidence.

All unit tests pass. CSS class "heatmap-cell" enables frontend
toggling (Phase 7.9.3).

Closes: pdftract-67p2c
2026-05-24 11:08:09 -04:00
jedarden
e6bf3dd290 feat(pdftract-3s2i): implement Phase 5.5.2 validation filter
Implement per-word validation filter for assisted-OCR BrokenVector path.

Changes:
- Add SpanSource::OcrAssisted variant to hybrid.rs
- Add Span::ocr_assisted() helper method
- Implement validate_ocr_with_position_hints() in ocr.rs
  - 5pt distance threshold for position validation
  - 0.4 confidence cap for rejected words
  - Linear scan for nearest-neighbor lookup
- Add unit tests for validation filter

Closes: pdftract-3s2i

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-24 04:57:17 -04:00
jedarden
cd1b6377b6 feat(pdftract-saddv): implement inspector JSON-tree click navigation
Add data-span-index attribute to span rectangles for click navigation
between SVG canvas and JSON-tree panel. Updated render_spans() to use
enumerate() for tracking indices. Added unit tests for index assignment.

Created demo HTML file demonstrating the full click navigation feature:
- Click span rect -> scroll JSON tree to matching entry
- Highlight target node with yellow background for 2 seconds
- Auto-open ancestor <details> elements
- Smooth scrollIntoView with center alignment

Acceptance criteria:
- PASS: data-span-index attribute added to all spans
- PASS: Click handler scrolls tree to matching node
- PASS: .highlighted class applied for 2 seconds
- PASS: Ancestor details auto-opened before scroll
- PASS: 9 unit tests pass including new span_index test

Closes: pdftract-saddv

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-24 03:35:24 -04:00
jedarden
25f1081d7d feat(pdftract-p4vzu): implement inspector render_spans layer
Implements the span layer renderer for the inspector debug viewer.
Renders SVG outline rectangles for each text span, color-coded by
extraction confidence. Red (< 0.5), yellow (0.5-0.8), and green (> 0.8)
indicate low, medium, and high confidence respectively. Gray indicates
direct extraction without OCR.

Each rect includes data-* attributes for tooltip and click consumption:
- data-text: the extracted text content (XML-escaped)
- data-confidence: confidence score or empty string
- data-font: font name (XML-escaped)
- data-size: font size in points

All 10 unit tests pass. The implementation follows the existing SVG
generation pattern in pdftract-core/src/receipts/svg.rs.

Closes: pdftract-p4vzu
2026-05-24 03:11:34 -04:00