spaxel/PROGRESS.md

648 lines
30 KiB
Markdown
Raw Permalink Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

# Spaxel Implementation Progress
## Phase 1 — Foundation
Goal: Bare-minimum loop from ESP32 to browser. Zero-config with passive radar and mDNS from day one.
### Status: COMPLETE
| Item | Status | Notes |
|------|--------|-------|
| ESP32 firmware skeleton | **Done** | See iteration 2 below |
| Passive radar support | **Done** | BSSID filter in csi.c |
| BLE scanning | **Done** | Core 0 concurrent with WiFi |
| Mothership WebSocket ingestion | **Done** | See iteration 1 below |
| Dashboard skeleton | **Done** | See iteration 3 below |
| Docker packaging | **Done** | See iteration 4 below |
## Phase 2 — Signal Processing & Detection
Goal: Detect presence on a single link.
### Status
| Item | Status | Notes |
|------|--------|-------|
| Phase sanitisation | **Done** | See iteration 5 below |
| Baseline system | **Done** | EMA with motion-gated updates |
| Motion detection | **Done** | deltaRMS, NBVI selection |
| Dashboard presence indicator | **Pending** | |
| CSI recording buffer | **Pending** | |
| Adaptive sensing rate | **Pending** | |
### Iteration Log
#### Iteration 5 — 2026-03-26
**Completed:** Signal processing package (phase sanitisation, baseline, motion detection)
Implemented the core signal processing pipeline in Go with:
- **Phase sanitization (`signal/phase.go`):**
- Complex CSI computation: int8 I/Q → float64 complex → amplitude/phase
- RSSI normalization (AGC compensation): `norm = 10^((rssi_ref - rssi)/20)`
- Spatial phase unwrapping: correct 2π jumps between adjacent subcarriers
- Linear regression (OLS): fit `phase = a*k + b` over data subcarriers
- STO/CFO removal: residual phase = unwrapped - (slope × k + intercept)
- HT20 subcarrier map: 64 total, 46 data (excluding null, guard, pilot)
- **Baseline system (`signal/baseline.go`):**
- EMA baseline per link per subcarrier: `baseline = α×amplitude + (1-α)×baseline`
- α = dt / (τ + dt) ≈ 0.0033 for dt=0.1s, τ=30s
- Motion-gated updates: only update when smoothDeltaRMS < 0.05
- Confidence scoring: 0.3 for stale baselines (>7 days), asymptotically → 1.0
- Snapshot/restore for SQLite persistence
- BaselineManager for multi-link coordination
- **Motion detection (`signal/features.go`):**
- NBVI (Normalized Bandwidth Variance Index): `Var(amp) / Mean(amp)²`
- Welford's online algorithm for numerically stable variance
- Top-16 subcarrier selection by NBVI score
- deltaRMS: `sqrt(mean((amp - baseline)²))` over selected subcarriers
- Exponential smoothing: `smooth = 0.3×raw + 0.7×prev`
- Motion threshold: smoothDeltaRMS > 0.02
- **Link processor (`signal/processor.go`):**
- LinkProcessor: ties together phase sanitization, baseline, motion detection
- ProcessorManager: manages per-link processors with thread-safe access
- GetAllMotionStates(): returns motion state for all links
- GetAllBaselines()/RestoreBaseline(): for SQLite persistence
**Constants used (from plan):**
- RSSIRefdBm = -30.0
- DefaultMotionThreshold = 0.05
- DefaultDeltaRMSThreshold = 0.02
- NBVITopCount = 16
- NBVIMinThreshold = 0.001
- DeltaRMSSmoothingAlpha = 0.3
**Tests:** 37 tests covering phase sanitization, baseline, NBVI, motion detection. All pass.
**Files created:**
```
mothership/internal/signal/
├── phase.go — Phase sanitization algorithms
├── phase_test.go — 15 tests for phase processing
├── baseline.go — EMA baseline management
├── baseline_test.go — 9 tests for baseline
├── features.go — NBVI selection, deltaRMS, motion detection
├── features_test.go — 13 tests for features
└── processor.go — LinkProcessor, ProcessorManager
```
**Remaining for Phase 2:**
- Dashboard presence indicator
- CSI recording buffer
- Adaptive sensing rate
#### Iteration 4 — 2026-03-26
**Completed:** Docker packaging
Implemented container deployment with:
- **Dockerfile:** Multi-stage build for minimal production image
- Stage 1: `golang:1.23-bookworm` builder with module caching
- Stage 2: `distroless/static-debian12:nonroot` runtime (no shell, runs as UID 65532)
- CGO_ENABLED=0 build (pure-Go SQLite compatible)
- Dashboard static files copied to `/dashboard/`
- Firmware directory as volume mount point (`/firmware/`)
- Built-in healthcheck via wget
- **docker-compose.yml:** Production-ready orchestration
- `network_mode: host` for mDNS multicast discovery (required for ESP32 nodes)
- Volume mounts: `spaxel-data` for persistence, `./firmware` for OTA binaries
- Environment variables: TZ, mDNS config, optional MQTT
- Resource limits: 512m RAM, 2 CPUs (scalable to 1g for 16+ nodes)
- 35s stop_grace_period for graceful shutdown
- Ulimits: 4096/8192 file descriptors for node connections
- Traefik labels (disabled by default, enable for TLS/proxy)
- **Supporting files:**
- `VERSION` — 0.1.0 for image tagging
- `.dockerignore` — Excludes docs, build artifacts, IDE files
**Key design decisions:**
- Host networking is REQUIRED for mDNS — Docker bridge blocks multicast 224.0.0.251
- distroless image minimizes attack surface (no shell, no package manager)
- Firmware binaries not bundled — users mount their own `/firmware` volume
- Traefik labels included but disabled — enable for production TLS
**Files created:**
```
Dockerfile
docker-compose.yml
VERSION
.dockerignore
```
**Phase 1 Status:** COMPLETE
All Phase 1 items implemented:
- ✅ ESP32 firmware skeleton
- ✅ Passive radar support
- ✅ BLE scanning
- ✅ Mothership WebSocket ingestion
- ✅ Dashboard skeleton
- ✅ Docker packaging
**Next:** Phase 2 — Signal Processing (baseline, deltaRMS, Fresnel zones)
#### Iteration 3 — 2026-03-26
**Completed:** Dashboard skeleton with 3D visualization
Implemented the web dashboard in vanilla JS + Three.js with:
- **Static file structure:** `dashboard/` directory with HTML/JS
- `index.html` — Dark theme UI with status bar, node/link panels, amplitude chart
- `js/app.js` — Main application (~350 lines)
- **3D Scene (Three.js):**
- Ground grid (10×10m, 20 divisions)
- OrbitControls for pan/zoom/rotate with damping
- Axes helper for orientation
- Responsive canvas with devicePixelRatio support
- FPS counter in status bar
- **WebSocket connection (`/ws/dashboard`):**
- Auto-reconnect with 3s backoff
- JSON message handling for state, node events, link events
- Binary CSI frame parsing (24-byte header + I/Q payload)
- Connection status indicator (green/red dot)
- **Node/Link panels:**
- Live list of connected nodes with MAC, firmware, chip
- Active links with node:peer MAC pairs
- Click-to-select for amplitude chart display
- **Amplitude chart (Canvas 2D):**
- 64-bar visualization of subcarrier amplitudes
- Real-time update from selected link's CSI frames
- Color gradient based on amplitude intensity
- Channel and RSSI display overlay
- **Dashboard package (Go):**
- `internal/dashboard/hub.go` — Hub for client management and broadcasting
- `internal/dashboard/server.go` — WebSocket handler with ping/pong keepalive
- `internal/dashboard/hub_test.go` — 5 tests for hub operations
- IngestionState interface for querying node/link state
- CSIBroadcaster interface implementation
- **Main.go updates:**
- Static file serving with SPA fallback
- Dashboard WebSocket endpoint at `/ws/dashboard`
- Auto-discovery of dashboard directory
- Wiring between ingestion and dashboard packages
**Dependencies used (frontend):**
- Three.js r128 (CDN)
- OrbitControls (CDN)
**Tests:** 5 new tests for dashboard hub. All 27 tests pass.
**Files created:**
```
dashboard/
├── index.html
└── js/
└── app.js
mothership/internal/dashboard/
├── hub.go
├── hub_test.go
└── server.go
```
**Remaining for Phase 1:**
- Docker packaging
#### Iteration 2 — 2026-03-26
**Completed:** ESP32-S3 firmware skeleton
Implemented the full ESP32 firmware in ESP-IDF C with:
- **Project structure:** Standard ESP-IDF layout with `firmware/` root
- Top-level `CMakeLists.txt`, `sdkconfig.defaults`, `partitions.csv` (factory + OTA slots)
- `main/` component with 5 source modules
- **State machine (main.c):** 7-state node lifecycle
- BOOT → WIFI_CONNECTING → MOTHERSHIP_DISCOVERY → CONNECTED
- Degraded states: WIFI_LOST, MOTHERSHIP_UNAVAILABLE, CAPTIVE_PORTAL
- Exponential backoff on WiFi failures (1s → 30s max)
- 10-failure threshold before captive portal
- **WiFi module (wifi.c/h):**
- STA connection with exponential backoff
- mDNS discovery for `_spaxel._tcp.local` with fallback to cached IP
- Captive portal AP mode (`spaxel-XXXX`) with HTTP config page
- Event-driven connection state via FreeRTOS event group
- **WebSocket client (websocket.c/h):**
- Bidirectional communication on single connection
- Binary CSI frame transmission (24-byte header + I/Q payload)
- JSON message handling: hello, health, ble, ota_status upstream
- Downstream command parsing: role, config, ota, reboot, identify, reject
- OTA download task with progress reporting and automatic reboot
- **CSI capture (csi.c/h):**
- WiFi promiscuous mode with CSI callback
- Queue-based processing (32-frame buffer)
- Passive mode BSSID filtering for radar
- On-device amplitude variance tracking for motion hints (Welford's algorithm)
- TX task for active probing
- **BLE scanner (ble.c/h):**
- Passive BLE scanning on Core 0 (concurrent with WiFi)
- Device cache (60 entries) with name and manufacturer data parsing
- 5-second reporting interval via WebSocket
- GAP event handling for advertisement processing
- **NVS persistence:** Full schema with 15 keys
- WiFi credentials, node ID/token, mothership config
- Role/rate persistence for degraded mode operation
- Schema versioning for migration support
**Files created:**
```
firmware/
├── CMakeLists.txt
├── sdkconfig.defaults
├── partitions.csv
└── main/
├── CMakeLists.txt
├── spaxel.h
├── main.c
├── wifi.h / wifi.c
├── websocket.h / websocket.c
├── csi.h / csi.c
└── ble.h / ble.c
```
**Phase 1 Status:** COMPLETE
All Phase 1 items implemented:
- ✅ ESP32 firmware skeleton
- ✅ Passive radar support
- ✅ BLE scanning
- ✅ Mothership WebSocket ingestion
- ✅ Dashboard skeleton
- ✅ Docker packaging
**Next:** Phase 2 — Signal Processing (baseline, deltaRMS, Fresnel zones)
#### Iteration 1 — 2026-03-26
**Completed:** Mothership WebSocket ingestion server
Implemented the core ingestion server in Go with:
- **Module structure:** `mothership/` with `cmd/mothership/` entrypoint and `internal/ingestion/` package
- **WebSocket endpoint:** `/ws/node` accepts bidirectional connections from ESP32 nodes
- **Binary frame parsing:** 24-byte header + variable payload, per spec in plan.md
- Validation: min/max length, payload size match, channel validity (1-14), subcarrier limit (128)
- Malformed frame tracking with warn/close thresholds (100/1000 per minute)
- **JSON message handling:** Parses hello, health, ble, motion_hint, ota_status
- **Per-link ring buffers:** 256-sample circular buffers keyed by `nodeMAC:peerMAC`
- **Connection lifecycle:** Node registration via hello, ping/pong keepalive (30s/60s), graceful shutdown
- **mDNS advertisement:** `_spaxel._tcp.local` via github.com/hashicorp/mdns
- **Role/config push:** Sends initial `rx` role and 20 Hz config on connect
- **Health endpoint:** `GET /healthz` returns `{"status":"ok","version":"..."}`
**Dependencies used:**
- `github.com/go-chi/chi` — HTTP routing
- `github.com/gorilla/websocket` — WebSocket server
- `github.com/hashicorp/mdns` — mDNS advertisement
**Tests:** 22 tests covering frame parsing, JSON messages, and ring buffer operations. All pass.
**Files created:**
```
mothership/
├── cmd/mothership/main.go
├── go.mod
├── go.sum
└── internal/ingestion/
├── frame.go
├── frame_test.go
├── message.go
├── message_test.go
├── ring.go
├── ring_test.go
└── server.go
```
## Phase 7 — Learning & Analytics
Goal: The system gets smarter over time. User feedback drives improvement.
### Status: COMPLETE
| Item | Status | Notes |
|------|--------|-------|
| Detection feedback loop | **Done** | Thumbs up/down on detections |
| Self-improving localization | **Done** | BLE ground truth drives weight refinement |
| Presence prediction | **Done** | See iteration 6 below |
| Sleep quality monitoring | **Done** | Breathing analysis + motion scoring |
| Crowd flow visualization | **Done** | Trajectory accumulation into directional flow map |
| Anomaly detection & security mode | **Done** | 7-day pattern learning |
### Iteration 6 — 2026-04-09
**Completed:** Presence prediction for Home Assistant integration
Implemented the full presence prediction system with:
- **Per-person transition probability tracking (`prediction/model.go`):**
- `zone_transitions_history` table with all zone transitions (person_id, from_zone, to_zone, hour_of_week, dwell_duration)
- `transition_probabilities` table with Laplace-smoothed probabilities
- `dwell_times` table with mean/stddev dwell time per person/zone/hour
- `person_zone_entry` table for tracking current person positions
- Zone transition recording via `PersonZoneChange()` method
- Automatic probability recomputation with Laplace smoothing
- Dwell time statistics with mean/stddev computation
- **Per-zone occupancy patterns (`prediction/accuracy.go`):**
- `zone_occupancy_patterns` table with occupancy_prob per zone/hour_of_week
- `zone_occupancy_history` table tracking entries/exits with timestamps
- `recorded_predictions` table for tracking prediction accuracy
- `accuracy_stats` table with rolling 7-day accuracy metrics
- Zone occupancy pattern computation from historical data
- Pattern-based occupancy prediction at target time
- **Time-slot based predictions (`prediction/horizon.go`):**
- Monte Carlo simulation with 1000 runs for probabilistic predictions
- Multi-step path simulation accounting for dwell times
- Normal distribution sampling for dwell time variability
- Horizon predictions at 5, 15, and 30 minutes
- Returns probability distribution over all zones
- Confidence scoring based on simulation agreement
- **HA sensor exposure (`mqtt/client.go`):**
- `PublishPredictionSensors()` creates HA auto-discovery configs
- `UpdatePredictionState()` publishes current predictions to MQTT
- Three sensors per person:
- `sensor.spaxel_<person>_predicted_zone` - zone name
- `sensor.spaxel_<person>_prediction_confidence` - percentage
- `sensor.spaxel_<person>_transition_minutes` - estimated minutes
- Topics follow HA discovery pattern: `homeassistant/sensor/.../config`
- **REST API endpoints (`api/prediction.go`):**
- `GET /api/predictions` - Get current predictions for all people
- `GET /api/predictions?person=<id>&horizon=<min>` - Filtered predictions
- `GET /api/predictions/stats` - Transition count, data age, model readiness
- `POST /api/predictions/recompute` - Force probability recomputation
- `GET /api/predictions/accuracy` - Per-person accuracy stats
- `GET /api/predictions/accuracy/overall` - Overall system accuracy
- `GET /api/predictions/accuracy/{personID}` - Person-specific accuracy
- `GET /api/predictions/horizon` - Monte Carlo horizon predictions
- `GET /api/predictions/horizon/{personID}` - Person-specific horizon prediction
- `GET /api/predictions/patterns/zones` - Zone occupancy patterns
- `GET /api/predictions/probabilities/{personID}` - Transition probabilities
- `GET /api/predictions/samples/{personID}/zone/{zoneID}` - Sample counts
- **Main application wiring (`cmd/mothership/main.go`):**
- Prediction module initialization (lines 492-534)
- Zone transition recording on portal crossings (lines 1579-1581)
- Provider wiring for zones, people, positions (lines 1831-1863)
- MQTT client integration for prediction publishing (lines 1846-1863)
- Periodic prediction update loop every 60 seconds (lines 1866-1888)
- Periodic prediction evaluation every 30 seconds (lines 1931-1983)
- REST API endpoint registration (lines 2527-2888)
**Constants and thresholds:**
- MinimumDataAge = 7 days (168 hours) before predictions activate
- MinimumSamplesPerSlot = 3 observations per time slot
- PredictionHorizon = 15 minutes (default)
- MonteCarloRuns = 1000 simulations
- TargetAccuracy = 75% at 15-minute horizon
**Accuracy tracking:**
- Records predictions when made (personID, currentZone, predictedZone, confidence, horizon)
- Evaluates pending predictions when target time is reached
- Compares predicted zone vs actual zone
- Computes rolling 7-day accuracy percentage
- Reports "meets_target" when accuracy ≥ 75% and min predictions threshold met
**Model learning:**
- Observations recorded every 5 minutes per person/zone
- EMA update: `p_new = p_old + α × (obs - p_old)` where α = 0.03
- Cold start: 7 days of data required for model readiness
- Slot ready when sample_count ≥ 3
- Automatic recomputation triggered on zone transitions
**Files created/modified:**
```
mothership/internal/prediction/
├── model.go — ModelStore, transition probabilities, dwell times
├── predictor.go — Predictor for presence prediction
├── horizon.go — HorizonPredictor with Monte Carlo simulation
├── accuracy.go — AccuracyTracker for prediction evaluation
├── history.go — HistoryUpdater for zone transition recording
├── adapter.go — Provider adapters for zones, people, positions
├── model_test.go — Tests for model store operations
├── predictor_test.go — Tests for prediction logic
├── accuracy_test.go — Tests for accuracy tracking
└── horizon_test.go — Tests for horizon predictions
mothership/internal/api/
├── prediction.go — REST API handlers for predictions
└── prediction_test.go — Tests for prediction API endpoints
mothership/internal/mqtt/
└── client.go — MQTT client with prediction sensor publishing
```
**Acceptance criteria met:**
- ✅ Per-person transition probability tracking - Full implementation with Laplace smoothing
- ✅ Per-zone occupancy patterns - Historical patterns with probability computation
- ✅ Time-slot based predictions - Monte Carlo simulation at configurable horizons
- ✅ HA sensor exposure for predicted states - Full auto-discovery with 3 sensors per person
- ✅ >75% accuracy at 15-minute horizon - AccuracyTracker with rolling 7-day window
**Phase 7 Status:** COMPLETE
## Phase 8 — Analysis & Developer Tools
Goal: Deep debugging, system tuning, and detection explainability.
### Status: COMPLETE
| Item | Status | Notes |
|------|--------|-------|
| Activity timeline (Component 27) | **Done** | Universal event stream with tap-to-time-travel |
| Detection explainability (Component 28) | **Done** | X-ray overlay, per-link contributions, BLE match details |
| Time-travel debugging | **Done** | Pause live, scrub timeline, parameter tuning overlay |
| Pre-deployment simulator | **Done** | Virtual space + nodes + walkers, GDOP overlay |
| CSI simulator (`cmd/sim`) | **Done** | Go CLI for hardware-free testing |
| Fresnel zone debug overlay | **Done** | Toggle wireframe ellipsoids in 3D scene |
### Implementation Summary
**Activity timeline (`internal/timeline/`):**
- `Storage` subscribes to EventBus and writes events to SQLite asynchronously via buffered queue
- Handles all event types: detections, zone transitions, alerts, system events, learning milestones
- WebSocket push of new events to dashboard clients in real-time
- REST API: `GET /api/events` with cursor-based pagination, filters (type/zone/person/time), and FTS5 search
- Frontend: `sidebar-timeline.js` — virtualized list, tap-to-time-travel, inline feedback buttons
**Detection explainability (`internal/explainability/`):**
- `Handler` maintains per-blob explanation data updated by the fusion engine
- Per-link contribution table: deltaRMS, Fresnel zone number, learned weight, contribution amount
- BLE match details: per-node RSSI, triangulation position, confidence
- Fresnel zone ellipsoid geometry for 3D visualization
- Frontend: `explainability.js` — X-ray overlay dims non-contributors, glowing contributing links
**Time-travel debugging (`internal/replay/`):**
- Append-only `csi_replay.bin` with per-frame records (recv_time_ms + raw CSI binary)
- `Worker` manages replay sessions: play/pause/seek/speed control
- Parameter tuning: `PATCH /api/replay/params` re-runs pipeline on buffered data at max speed
- "Apply to Live" copies tuned params to the running pipeline
- Dashboard: timeline scrubber integrated with activity timeline events
**Pre-deployment simulator (`internal/simulator/`):**
- `Space` defines room geometry with wall segments and material properties
- `NodeSet` manages virtual TX/RX node placement
- `WalkerSet` simulates random-walk or path-following persons
- Two-ray propagation model with path loss + wall penetration + first-order reflections
- GDOP computation per cell using Fisher information matrix
- REST API at `/api/simulator/*` for space/node/walker management and GDOP computation
**CSI simulator CLI (`cmd/sim/`):**
- Connects to mothership as virtual nodes, sends synthetic CSI binary frames
- Walker random-walk model with Gaussian velocity updates, wall reflection
- Amplitude/phase generated from propagation model with Gaussian noise injection
- Optional BLE advertisement simulation (`--ble` flag)
- Verified authentication (exits non-zero on `{type:"reject"}`)
- Integration test support: polls `GET /api/blobs` for blob count assertions
**Fresnel zone debug overlay (`dashboard/js/fresnel.js`):**
- Toggle-able wireframe ellipsoids between active TX/RX link pairs
- Ellipsoid geometry computed from TX/RX positions and Fresnel zone number
- Color-coded by zone number (zone 1 = bright, outer zones = dimmer)
- Toolbar button integration with existing layers panel
**Files created/modified:**
```
mothership/internal/timeline/ — timeline.go, timeline_test.go, handler.go, buffer_adapter.go
mothership/internal/explainability/ — handler.go
mothership/internal/replay/ — engine.go, engine_test.go, pipeline.go, pipeline_test.go,
session.go, store.go, store_test.go, types.go, worker.go
mothership/internal/simulator/ — accuracy.go, engine.go, gdop.go, handler.go, node.go,
physics.go, propagation.go, registry_bridge.go, session.go,
space.go, virtual_state.go, walker.go + test files
mothership/cmd/sim/ — main.go, generator.go, verify.go, walker.go, main_test.go
mothership/internal/api/ — replay.go, replay_test.go, simulator.go
dashboard/js/ — explainability.js, replay.js, fresnel.js, sidebar-timeline.js
```
**Phase 8 Status:** COMPLETE
## Phase 9 — UX Polish & Accessibility
Goal: Accessible to every household member. Power user efficiency. Always-on ambient display.
### Status: COMPLETE
| Item | Status | Notes |
|------|--------|-------|
| Simple mode (progressive disclosure) | **Done** | Card-based mobile-first UI, room cards, activity feed |
| Ambient dashboard mode (Component 31) | **Done** | `/ambient` route, Canvas 2D, time-of-day palette, auto-dim |
| Spatial quick actions (Component 32) | **Done** | Right-click / long-press context menus on 3D elements |
| Command palette (Component 34) | **Done** | Ctrl+K / Cmd+K, fuzzy search, navigate time, execute commands |
| Morning briefing (Component 35) | **Done** | Daily summary card on first open, push notification support |
| Guided troubleshooting (Component 36) | **Done** | Proactive contextual help, dismissible, never repeats |
| Mobile-responsive expert mode | **Done** | Touch orbit/pan/zoom, hamburger menu, FXAA on mobile |
| Fleet status page | **Done** | Full table with OTA progress, bulk actions, camera fly-to |
### Implementation Summary
**Simple mode (`dashboard/simple.html`, `dashboard/js/simple.js`):**
- Card-based layout: one room card per zone with occupancy count and person names
- Activity feed as chronological event list from timeline REST API
- Alert banner for fall detection, anomaly alerts, system warnings
- Sleep summary card for morning view
- No 3D scene — designed for non-technical household members
- Toggle button in toolbar; per-user default stored in `localStorage`
**Ambient dashboard (`dashboard/ambient.html`, `dashboard/js/ambient.js`):**
- Served at `/ambient` — separate lightweight route for wall-mounted tablets
- Canvas 2D renderer: colored circles for people, zone labels, soft glow effects
- Time-of-day palette: morning (cool), day (neutral), evening (amber), night (very dim)
- Auto-dim when house empty for 30+ min; gentle fade-in on person detection
- Alert mode: pulsing red border + large text + action buttons on fall/security events
- Morning briefing integration: briefing text shown on first detection, fades after 30 s
- Reconnect backoff handles WebSocket drops gracefully
**Spatial quick actions (`dashboard/js/quick-actions.js`):**
- Three.js Raycaster determines target under cursor (person/node/zone/portal/trigger/empty)
- Context menu component renders appropriate options per target type
- Per-blob: "Who is this?", "Why?", "Follow" camera, "Create automation", "Mark incorrect"
- Per-node: "Diagnostics", "Blink LED", "Reposition", "Update firmware", "Show links"
- Per-empty: "What happened here?", "Add trigger zone", "Add virtual node", "Coverage quality"
- Per-zone: "Zone history", "Edit zone", "Create automation", "Crowd flow"
- "Follow" mode: camera smoothly tracks person, auto-orbiting to keep them centered
**Command palette (`dashboard/js/command-palette.js`):**
- Ctrl+K (Cmd+K on Mac) opens universal search and command interface
- Fuzzy matching across zones, persons, nodes, settings, help topics, events
- Navigate time: "last night 2am", "yesterday kitchen", "this morning"
- Execute commands: "update all nodes", "re-baseline kitchen", "arm security"
- Help: "help fall detection", "why false positive", "troubleshoot kitchen"
- Recently used commands surface first; expert mode only
**Morning briefing (`internal/briefing/`, `dashboard/js/briefing.js`):**
- `Generator` assembles briefing in priority order from sleep, events, anomalies, system health
- Priority blocks: critical alerts → sleep summary → who is home → overnight anomalies → system health → predictions → learning progress
- Degenerate case: "All quiet last night. All systems healthy."
- Stored in `briefings` SQLite table (one per day per person)
- REST API: `GET /api/briefing`, `GET /api/briefing/current`
- Dashboard: card overlay on first open, dismissible, slides away after 10 s
**Guided troubleshooting (`internal/guidedtroubleshoot/`, `dashboard/js/troubleshoot.js`):**
- Trigger conditions: detection quality drops, repeated setting changes, node offline >2 h
- Repeated-edit detection: per-key counter in memory; hint delivered in `GET /api/settings` response as `"repeated_edit_hint": true`
- Proactive diagnostic flow: check connectivity → show link health → suggest repositioning → offer re-baseline
- First-time feature tooltips shown once, dismissed on click, stored in `localStorage`
- Post-feedback explanations in timeline after incorrect/missed detection feedback
**Mobile-responsive expert mode (`dashboard/js/mobile.js` + CSS):**
- Touch orbit (one finger), pan (two fingers), pinch-zoom (two fingers)
- FXAA anti-aliasing replaces MSAA on mobile (better performance on low-power GPUs)
- Hamburger menu for toolbar panels on small screens
- Viewport meta tag with `viewport-fit=cover` for notch-aware layout
- CSS Grid layout collapses gracefully on narrow viewports
**Fleet status page (`dashboard/fleet.html`, `dashboard/js/fleet-page.js`):**
- Full table with sortable columns: Name, MAC, Role, Position (fly-to), Firmware, RSSI, Status, Uptime, Actions
- OTA progress bar per node during updates (PENDING → DOWNLOADING → REBOOTING → VERIFIED / FAILED)
- Bulk actions: Update All (rolling OTA), Re-baseline All, Export Config, Import Config
- Camera fly-to: clicking position coordinates in table jumps 3D camera to that node
- Responsive layout works on both desktop and tablet
**Files created/modified:**
```
dashboard/simple.html — Simple mode page
dashboard/ambient.html — Ambient dashboard page
dashboard/fleet.html — Fleet status page
dashboard/js/simple.js — Simple mode WebSocket + card rendering
dashboard/js/simplemode.js — Simple mode toggle and state management
dashboard/js/ambient.js — Ambient dashboard controller
dashboard/js/ambient_renderer.js — Canvas 2D renderer with time-of-day palette
dashboard/js/ambient_briefing.js — Morning briefing integration for ambient
dashboard/js/quick-actions.js — Context menu for 3D scene elements
dashboard/js/command-palette.js — Universal search and command interface
dashboard/js/briefing.js — Morning briefing card overlay
dashboard/js/troubleshoot.js — Guided troubleshooting UI
dashboard/js/guided-help.js — First-time feature discovery tooltips
dashboard/js/mobile.js — Mobile touch controls and FXAA
dashboard/js/fleet-page.js — Fleet status table and bulk actions
mothership/internal/briefing/ — briefing.go, briefing_test.go, scheduler.go,
dashboard_adapter.go, notify_adapter.go
mothership/internal/guidedtroubleshoot/ — discovery.go, notifier.go, quality.go,
linkweather.go, reposition.go, alert_handler.go
mothership/internal/api/ — briefing.go, briefing_test.go, guided.go
```
**Phase 9 Status:** COMPLETE