Add support for displaying IncompleteIntegration warning type
in the miroir-ctl explain command human-readable output.
This warns users when optional integrations (task store,
replica selector, tenant affinity manager) are not configured.
Closes: bf-5pico
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Implements admin API endpoints and CLI commands for managing tenant
mappings (api_key mode) as specified in plan §13.15:
Admin API endpoints:
- POST /_miroir/tenants - Add a tenant mapping (api_key → tenant_id → group_id)
- GET /_miroir/tenants - List all tenant mappings
- DELETE /_miroir/tenants - Delete a tenant mapping by api_key
CLI commands (miroir-ctl tenant):
- miroir-ctl tenant add --api-key KEY --tenant ID --group N
- miroir-ctl tenant list
- miroir-ctl tenant remove --api-key KEY
TaskStore changes:
- Added list_tenant_mappings() method to TaskStore trait
- Implemented in SQLite and Redis backends
- Updated all MockTaskStore implementations in test files
Security: API keys are hashed using SHA-256 before storage (never stored
plaintext). Mappings are persisted to task_store for HA deployments.
Closes: bf-38mn2
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Add comprehensive integration tests for plan §8 requirements:
- Document round-trip: 1000 docs indexed and retrieved, verified distributed across ≥2 nodes
- Search covers all shards: 100 docs with unique keywords, each search returns 1 hit
- Facet aggregation: 100 docs across 3 colors, facet counts sum to 100
- Offset/limit paging: 50 docs, 5 pages of 10 match single limit=50 query
- Settings broadcast: synonyms propagated to all 3 nodes
- Task polling: 500 doc batch, poll until succeeded
- Node failure with RF=2: marked #[ignore], requires docker-compose-dev-rf2.yml
All tests use docker-compose-dev stack (3 Meilisearch nodes + Miroir).
Closes: bf-45zni
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Implements complete multi-target alias ILM integration (plan §13.7):
- Add TaskStore::upsert_alias for ILM multi-target alias updates
- Update ILM to use upsert_alias instead of create_alias for rollovers
- Implement miroir-ctl alias commands (create, delete, list, show)
- Add alias kind and manager display to CLI output
- Document multi-target alias lifecycle and ILM ownership
Acceptance criteria met:
1. ✓ Operator edits to multi-target aliases return HTTP 409 miroir_multi_alias_not_writable
2. ✓ ILM exclusively manages multi-target aliases via kind='multi'
3. ✓ ILM atomic flips update target_uids and version correctly
4. ✓ Multi-target reads fan-out across all targets
5. ✓ Multi-target aliases reject writes with miroir_multi_alias_not_writable
6. ✓ miroir-ctl alias commands show alias kind and manager
7. ✓ Document multi-target alias lifecycle and ILM ownership
Closes: bf-5thu9
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Complete all TODO integrations in explainer.rs for query explain output:
- Alias lookup in task store with version info
- Tenant affinity resolution with hash fallback
- EWMA latency from replica selection
- Comprehensive test coverage for all integrations
- Updated miroir-ctl explain command with full output formatting
Closes: bf-5pico
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Add version attribute to clap Parser to enable --version flag,
matching the behavior of miroir-proxy.
Closes: bf-4cs1p
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
- Add multipart/form-data file upload support for POST /_miroir/dumps/import
- Implement fallback broadcast mode for dump_import config
- Update CLI to use multipart upload instead of JSON base64
- Add axum multipart feature to miroir-proxy
- Add reqwest multipart feature to miroir-ctl
- Update test to reflect broadcast mode acceptance
Acceptance criteria met:
- Streaming import routes documents per-shard (not 100% to each node)
- Large imports complete with batched per-target writes
- Metrics track bytes read, documents routed, rate
- Fallback broadcast mode works when streaming is disabled
Closes: bf-4u2n4
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
- Remove trailing blank lines in lib.rs
- Improve line breaking in documents.rs test
- Other minor formatting consistency fixes
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
- Run cargo clippy --fix to apply uninlined format args suggestions
- Fix deprecated IndexMap::remove calls in session_pinning.rs (use shift_remove)
- Various test and source files updated by clippy auto-fix
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Apply cargo clippy --fix to remove unused imports, prefix unused
variables with underscore, and fix various clippy warnings across
miroir-core, miroir-proxy, and miroir-ctl.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Add after_help text to all 17 miroir-ctl subcommands with links to their
runbook documentation in docs/ctl/*.md.
- status, node, rebalance, task, verify, dump, ui, reshard: core commands
- alias, canary, cdc, explain, shadow, tenant, ttl, key: feature commands
Acceptance criteria met:
✓ Every subcommand has a matching docs/ctl/*.md runbook (pre-existing)
✓ --help mentions where to find runbook (now added)
✓ Runbooks are all under 100 lines each (verified: max 67 lines)
Closes: miroir-uyx.4
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
- Created docs/ctl/*.md runbooks for all 16 miroir-ctl subcommands
- Each runbook includes: purpose, preconditions, examples, gotchas, see also
- Added runbook location to --help output
- All runbooks under 50 lines for easy reading
Closes: miroir-uyx.4
- Add unit tests for key rotation command (epoch_seconds, args validation,
serialization tests for MeiliKey and TopologyNode)
- Fix dump.rs compilation errors (unwrap_or type mismatches, missing Ok(()))
- Add Serialize derive to MeiliKey and TopologyNode structs
The key rotation CLI already implements the 4-step zero-downtime rotation
from plan §9. This commit adds test coverage and fixes unrelated compilation
issues in dump.rs that were blocking miroir-ctl builds.
Closes: miroir-46p.2
Implements the streaming routed dump import flow that routes documents
per-shard instead of broadcasting to all nodes.
Changes:
- Complete dump_import.rs with actual HTTP posting to nodes via NodeClient
- Inject `_miroir_shard` field into documents during routing
- Add proxy routes: POST /_miroir/dumps/import, GET /_miroir/dumps/import/{id}/status
- Wire up miroir-ctl dump import/status commands to call the API
- Add DumpImportPhase enum with as_str/from_str conversions
- Implement parallel flush with buffer_unordered and configurable concurrency
The import manager:
- Parses NDJSON incrementally
- Extracts primary key, computes shard_id via hash(pk) % S
- Routes to target nodes in all replica groups
- Flushes per-node buffers at batch_size intervals
- Tracks import status (phase, documents_processed, bytes_read)
CLI:
- miroir-ctl dump import --file <file> --index <uid> --primary-key <pk>
- miroir-ctl dump status --id <import_id>
Acceptance criteria:
- [ ] 500MB dump imported; no node's transient disk usage exceeds its share
- [ ] Mid-import pod failure: another pod picks up the next chunk
- [ ] Streaming vs broadcast mode produce same post-import content
- [ ] Import rate metric visible in Grafana
Closes: miroir-uhj.9
- Add explicit type parameters to Redis set/sadd/del/srem calls to resolve
type inference issues with the redis crate
- Add env var cleanup in credentials test to ensure test isolation
These changes fix compilation issues with Rust 1.87 and the redis crate.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Bead-Id: miroir-zc2.6
Add `miroir-ctl key rotate-node-master` command implementing plan §9
4-step zero-downtime rotation: create new admin-scoped key on all
Meilisearch nodes, print K8s Secret update instructions, wait for
rolling restart confirmation, delete old key. Supports --dry-run,
node auto-discovery via topology API, and rollback on step 1 failure.
Add `address` field to topology API NodeInfo for CLI node discovery.
Add runbooks for both nodeMasterKey (zero-downtime) and startup master
key (maintenance window required) rotation.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
- merger: deduplicate hits by primary key when multiple shards map to same node
- search: use shared AppState with live topology from health checker
- search: strip _miroir_shard always, _rankingScore only when not requested
- search: include facetDistribution only when facets were requested
- credentials: add mutex guards for env-var test isolation
- Add Phase 2 DoD integration tests: shard coverage, dedup, facets, paging,
degraded writes, error shape parity, topology shape, auth errors, reserved fields
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
cargo fmt reformats dump.rs match arms; credentials.rs needs #[allow(dead_code)]
on an unused public helper.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
- Add resharding load simulation model with real router hash functions
- Benchmark confirms storage amplification is exactly 2.0× and dual-write
amplification is exactly 2.0× across all test matrix scenarios (1KB/10GB,
10KB/100GB, 1MB/1TB), with hash distribution CV < 5% in all cases
- CLI window guard: resharding.allowed_windows config restricts resharding
to named time windows (e.g. "02:00-06:00 UTC"), CLI refuses outside
windows without --force
- Integration tests confirm rejection outside window, --force override,
no-restriction mode, and disabled config handling
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Enumerates dump variants that streaming mode can/can't handle.
- Added docs/dump-import/compatibility-matrix.md with comprehensive
compatibility matrix covering Meilisearch versions, dump variants,
and workarounds
- Added docs/dump-import/README.md as entry point
- Updated miroir-ctl dump command to reference matrix with helpful
error messages for unimplemented subcommands (import, export, analyze)
Addresses Open Problem #5: identifies what "can't reconstruct" means
in concrete terms, giving operators clear guidance on when broadcast
fallback is needed and what alternatives exist.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Add miroir-ctl management CLI with:
- clap root CLI with admin-key loading (env → credentials file → flag)
- All 15 subcommand stubs from plan §4
- Unit tests for credential loader priority order
- Clear "not yet implemented" messages pointing to tracking bead
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
- Update workspace Cargo.toml: explicit members list, edition 2021, MIT license, rust-version 1.87
- Simplify workspace.dependencies to core shared deps
- Update member crates to use explicit dependency versions where workspace inheritance was removed
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
- LICENSE: MIT (per plan §12)
- CHANGELOG.md: Keep a Changelog 1.1.0 skeleton with [Unreleased]
and [0.1.0] sections matching the awk extractor from plan §7
- .gitignore: Rust target/, editor junk; Cargo.lock kept in VCS
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
