spaxel/PROGRESS.md

30 KiB
Raw Blame History

Spaxel Implementation Progress

Phase 1 — Foundation

Goal: Bare-minimum loop from ESP32 to browser. Zero-config with passive radar and mDNS from day one.

Status: COMPLETE

Item Status Notes
ESP32 firmware skeleton Done See iteration 2 below
Passive radar support Done BSSID filter in csi.c
BLE scanning Done Core 0 concurrent with WiFi
Mothership WebSocket ingestion Done See iteration 1 below
Dashboard skeleton Done See iteration 3 below
Docker packaging Done See iteration 4 below

Phase 2 — Signal Processing & Detection

Goal: Detect presence on a single link.

Status

Item Status Notes
Phase sanitisation Done See iteration 5 below
Baseline system Done EMA with motion-gated updates
Motion detection Done deltaRMS, NBVI selection
Dashboard presence indicator Pending
CSI recording buffer Pending
Adaptive sensing rate Pending

Iteration Log

Iteration 5 — 2026-03-26

Completed: Signal processing package (phase sanitisation, baseline, motion detection)

Implemented the core signal processing pipeline in Go with:

  • Phase sanitization (signal/phase.go):

    • Complex CSI computation: int8 I/Q → float64 complex → amplitude/phase
    • RSSI normalization (AGC compensation): norm = 10^((rssi_ref - rssi)/20)
    • Spatial phase unwrapping: correct 2π jumps between adjacent subcarriers
    • Linear regression (OLS): fit phase = a*k + b over data subcarriers
    • STO/CFO removal: residual phase = unwrapped - (slope × k + intercept)
    • HT20 subcarrier map: 64 total, 46 data (excluding null, guard, pilot)
  • Baseline system (signal/baseline.go):

    • EMA baseline per link per subcarrier: baseline = α×amplitude + (1-α)×baseline
    • α = dt / (τ + dt) ≈ 0.0033 for dt=0.1s, τ=30s
    • Motion-gated updates: only update when smoothDeltaRMS < 0.05
    • Confidence scoring: 0.3 for stale baselines (>7 days), asymptotically → 1.0
    • Snapshot/restore for SQLite persistence
    • BaselineManager for multi-link coordination
  • Motion detection (signal/features.go):

    • NBVI (Normalized Bandwidth Variance Index): Var(amp) / Mean(amp)²
    • Welford's online algorithm for numerically stable variance
    • Top-16 subcarrier selection by NBVI score
    • deltaRMS: sqrt(mean((amp - baseline)²)) over selected subcarriers
    • Exponential smoothing: smooth = 0.3×raw + 0.7×prev
    • Motion threshold: smoothDeltaRMS > 0.02
  • Link processor (signal/processor.go):

    • LinkProcessor: ties together phase sanitization, baseline, motion detection
    • ProcessorManager: manages per-link processors with thread-safe access
    • GetAllMotionStates(): returns motion state for all links
    • GetAllBaselines()/RestoreBaseline(): for SQLite persistence

Constants used (from plan):

  • RSSIRefdBm = -30.0
  • DefaultMotionThreshold = 0.05
  • DefaultDeltaRMSThreshold = 0.02
  • NBVITopCount = 16
  • NBVIMinThreshold = 0.001
  • DeltaRMSSmoothingAlpha = 0.3

Tests: 37 tests covering phase sanitization, baseline, NBVI, motion detection. All pass.

Files created:

mothership/internal/signal/
├── phase.go          — Phase sanitization algorithms
├── phase_test.go     — 15 tests for phase processing
├── baseline.go       — EMA baseline management
├── baseline_test.go  — 9 tests for baseline
├── features.go       — NBVI selection, deltaRMS, motion detection
├── features_test.go  — 13 tests for features
└── processor.go      — LinkProcessor, ProcessorManager

Remaining for Phase 2:

  • Dashboard presence indicator
  • CSI recording buffer
  • Adaptive sensing rate

Iteration 4 — 2026-03-26

Completed: Docker packaging

Implemented container deployment with:

  • Dockerfile: Multi-stage build for minimal production image

    • Stage 1: golang:1.23-bookworm builder with module caching
    • Stage 2: distroless/static-debian12:nonroot runtime (no shell, runs as UID 65532)
    • CGO_ENABLED=0 build (pure-Go SQLite compatible)
    • Dashboard static files copied to /dashboard/
    • Firmware directory as volume mount point (/firmware/)
    • Built-in healthcheck via wget
  • docker-compose.yml: Production-ready orchestration

    • network_mode: host for mDNS multicast discovery (required for ESP32 nodes)
    • Volume mounts: spaxel-data for persistence, ./firmware for OTA binaries
    • Environment variables: TZ, mDNS config, optional MQTT
    • Resource limits: 512m RAM, 2 CPUs (scalable to 1g for 16+ nodes)
    • 35s stop_grace_period for graceful shutdown
    • Ulimits: 4096/8192 file descriptors for node connections
    • Traefik labels (disabled by default, enable for TLS/proxy)
  • Supporting files:

    • VERSION — 0.1.0 for image tagging
    • .dockerignore — Excludes docs, build artifacts, IDE files

Key design decisions:

  • Host networking is REQUIRED for mDNS — Docker bridge blocks multicast 224.0.0.251
  • distroless image minimizes attack surface (no shell, no package manager)
  • Firmware binaries not bundled — users mount their own /firmware volume
  • Traefik labels included but disabled — enable for production TLS

Files created:

Dockerfile
docker-compose.yml
VERSION
.dockerignore

Phase 1 Status: COMPLETE

All Phase 1 items implemented:

  • ESP32 firmware skeleton
  • Passive radar support
  • BLE scanning
  • Mothership WebSocket ingestion
  • Dashboard skeleton
  • Docker packaging

Next: Phase 2 — Signal Processing (baseline, deltaRMS, Fresnel zones)

Iteration 3 — 2026-03-26

Completed: Dashboard skeleton with 3D visualization

Implemented the web dashboard in vanilla JS + Three.js with:

  • Static file structure: dashboard/ directory with HTML/JS

    • index.html — Dark theme UI with status bar, node/link panels, amplitude chart
    • js/app.js — Main application (~350 lines)
  • 3D Scene (Three.js):

    • Ground grid (10×10m, 20 divisions)
    • OrbitControls for pan/zoom/rotate with damping
    • Axes helper for orientation
    • Responsive canvas with devicePixelRatio support
    • FPS counter in status bar
  • WebSocket connection (/ws/dashboard):

    • Auto-reconnect with 3s backoff
    • JSON message handling for state, node events, link events
    • Binary CSI frame parsing (24-byte header + I/Q payload)
    • Connection status indicator (green/red dot)
  • Node/Link panels:

    • Live list of connected nodes with MAC, firmware, chip
    • Active links with node:peer MAC pairs
    • Click-to-select for amplitude chart display
  • Amplitude chart (Canvas 2D):

    • 64-bar visualization of subcarrier amplitudes
    • Real-time update from selected link's CSI frames
    • Color gradient based on amplitude intensity
    • Channel and RSSI display overlay
  • Dashboard package (Go):

    • internal/dashboard/hub.go — Hub for client management and broadcasting
    • internal/dashboard/server.go — WebSocket handler with ping/pong keepalive
    • internal/dashboard/hub_test.go — 5 tests for hub operations
    • IngestionState interface for querying node/link state
    • CSIBroadcaster interface implementation
  • Main.go updates:

    • Static file serving with SPA fallback
    • Dashboard WebSocket endpoint at /ws/dashboard
    • Auto-discovery of dashboard directory
    • Wiring between ingestion and dashboard packages

Dependencies used (frontend):

  • Three.js r128 (CDN)
  • OrbitControls (CDN)

Tests: 5 new tests for dashboard hub. All 27 tests pass.

Files created:

dashboard/
├── index.html
└── js/
    └── app.js

mothership/internal/dashboard/
├── hub.go
├── hub_test.go
└── server.go

Remaining for Phase 1:

  • Docker packaging

Iteration 2 — 2026-03-26

Completed: ESP32-S3 firmware skeleton

Implemented the full ESP32 firmware in ESP-IDF C with:

  • Project structure: Standard ESP-IDF layout with firmware/ root

    • Top-level CMakeLists.txt, sdkconfig.defaults, partitions.csv (factory + OTA slots)
    • main/ component with 5 source modules
  • State machine (main.c): 7-state node lifecycle

    • BOOT → WIFI_CONNECTING → MOTHERSHIP_DISCOVERY → CONNECTED
    • Degraded states: WIFI_LOST, MOTHERSHIP_UNAVAILABLE, CAPTIVE_PORTAL
    • Exponential backoff on WiFi failures (1s → 30s max)
    • 10-failure threshold before captive portal
  • WiFi module (wifi.c/h):

    • STA connection with exponential backoff
    • mDNS discovery for _spaxel._tcp.local with fallback to cached IP
    • Captive portal AP mode (spaxel-XXXX) with HTTP config page
    • Event-driven connection state via FreeRTOS event group
  • WebSocket client (websocket.c/h):

    • Bidirectional communication on single connection
    • Binary CSI frame transmission (24-byte header + I/Q payload)
    • JSON message handling: hello, health, ble, ota_status upstream
    • Downstream command parsing: role, config, ota, reboot, identify, reject
    • OTA download task with progress reporting and automatic reboot
  • CSI capture (csi.c/h):

    • WiFi promiscuous mode with CSI callback
    • Queue-based processing (32-frame buffer)
    • Passive mode BSSID filtering for radar
    • On-device amplitude variance tracking for motion hints (Welford's algorithm)
    • TX task for active probing
  • BLE scanner (ble.c/h):

    • Passive BLE scanning on Core 0 (concurrent with WiFi)
    • Device cache (60 entries) with name and manufacturer data parsing
    • 5-second reporting interval via WebSocket
    • GAP event handling for advertisement processing
  • NVS persistence: Full schema with 15 keys

    • WiFi credentials, node ID/token, mothership config
    • Role/rate persistence for degraded mode operation
    • Schema versioning for migration support

Files created:

firmware/
├── CMakeLists.txt
├── sdkconfig.defaults
├── partitions.csv
└── main/
    ├── CMakeLists.txt
    ├── spaxel.h
    ├── main.c
    ├── wifi.h / wifi.c
    ├── websocket.h / websocket.c
    ├── csi.h / csi.c
    └── ble.h / ble.c

Phase 1 Status: COMPLETE

All Phase 1 items implemented:

  • ESP32 firmware skeleton
  • Passive radar support
  • BLE scanning
  • Mothership WebSocket ingestion
  • Dashboard skeleton
  • Docker packaging

Next: Phase 2 — Signal Processing (baseline, deltaRMS, Fresnel zones)

Iteration 1 — 2026-03-26

Completed: Mothership WebSocket ingestion server

Implemented the core ingestion server in Go with:

  • Module structure: mothership/ with cmd/mothership/ entrypoint and internal/ingestion/ package
  • WebSocket endpoint: /ws/node accepts bidirectional connections from ESP32 nodes
  • Binary frame parsing: 24-byte header + variable payload, per spec in plan.md
    • Validation: min/max length, payload size match, channel validity (1-14), subcarrier limit (128)
    • Malformed frame tracking with warn/close thresholds (100/1000 per minute)
  • JSON message handling: Parses hello, health, ble, motion_hint, ota_status
  • Per-link ring buffers: 256-sample circular buffers keyed by nodeMAC:peerMAC
  • Connection lifecycle: Node registration via hello, ping/pong keepalive (30s/60s), graceful shutdown
  • mDNS advertisement: _spaxel._tcp.local via github.com/hashicorp/mdns
  • Role/config push: Sends initial rx role and 20 Hz config on connect
  • Health endpoint: GET /healthz returns {"status":"ok","version":"..."}

Dependencies used:

  • github.com/go-chi/chi — HTTP routing
  • github.com/gorilla/websocket — WebSocket server
  • github.com/hashicorp/mdns — mDNS advertisement

Tests: 22 tests covering frame parsing, JSON messages, and ring buffer operations. All pass.

Files created:

mothership/
├── cmd/mothership/main.go
├── go.mod
├── go.sum
└── internal/ingestion/
    ├── frame.go
    ├── frame_test.go
    ├── message.go
    ├── message_test.go
    ├── ring.go
    ├── ring_test.go
    └── server.go

Phase 7 — Learning & Analytics

Goal: The system gets smarter over time. User feedback drives improvement.

Status: COMPLETE

Item Status Notes
Detection feedback loop Done Thumbs up/down on detections
Self-improving localization Done BLE ground truth drives weight refinement
Presence prediction Done See iteration 6 below
Sleep quality monitoring Done Breathing analysis + motion scoring
Crowd flow visualization Done Trajectory accumulation into directional flow map
Anomaly detection & security mode Done 7-day pattern learning

Iteration 6 — 2026-04-09

Completed: Presence prediction for Home Assistant integration

Implemented the full presence prediction system with:

  • Per-person transition probability tracking (prediction/model.go):

    • zone_transitions_history table with all zone transitions (person_id, from_zone, to_zone, hour_of_week, dwell_duration)
    • transition_probabilities table with Laplace-smoothed probabilities
    • dwell_times table with mean/stddev dwell time per person/zone/hour
    • person_zone_entry table for tracking current person positions
    • Zone transition recording via PersonZoneChange() method
    • Automatic probability recomputation with Laplace smoothing
    • Dwell time statistics with mean/stddev computation
  • Per-zone occupancy patterns (prediction/accuracy.go):

    • zone_occupancy_patterns table with occupancy_prob per zone/hour_of_week
    • zone_occupancy_history table tracking entries/exits with timestamps
    • recorded_predictions table for tracking prediction accuracy
    • accuracy_stats table with rolling 7-day accuracy metrics
    • Zone occupancy pattern computation from historical data
    • Pattern-based occupancy prediction at target time
  • Time-slot based predictions (prediction/horizon.go):

    • Monte Carlo simulation with 1000 runs for probabilistic predictions
    • Multi-step path simulation accounting for dwell times
    • Normal distribution sampling for dwell time variability
    • Horizon predictions at 5, 15, and 30 minutes
    • Returns probability distribution over all zones
    • Confidence scoring based on simulation agreement
  • HA sensor exposure (mqtt/client.go):

    • PublishPredictionSensors() creates HA auto-discovery configs
    • UpdatePredictionState() publishes current predictions to MQTT
    • Three sensors per person:
      • sensor.spaxel_<person>_predicted_zone - zone name
      • sensor.spaxel_<person>_prediction_confidence - percentage
      • sensor.spaxel_<person>_transition_minutes - estimated minutes
    • Topics follow HA discovery pattern: homeassistant/sensor/.../config
  • REST API endpoints (api/prediction.go):

    • GET /api/predictions - Get current predictions for all people
    • GET /api/predictions?person=<id>&horizon=<min> - Filtered predictions
    • GET /api/predictions/stats - Transition count, data age, model readiness
    • POST /api/predictions/recompute - Force probability recomputation
    • GET /api/predictions/accuracy - Per-person accuracy stats
    • GET /api/predictions/accuracy/overall - Overall system accuracy
    • GET /api/predictions/accuracy/{personID} - Person-specific accuracy
    • GET /api/predictions/horizon - Monte Carlo horizon predictions
    • GET /api/predictions/horizon/{personID} - Person-specific horizon prediction
    • GET /api/predictions/patterns/zones - Zone occupancy patterns
    • GET /api/predictions/probabilities/{personID} - Transition probabilities
    • GET /api/predictions/samples/{personID}/zone/{zoneID} - Sample counts
  • Main application wiring (cmd/mothership/main.go):

    • Prediction module initialization (lines 492-534)
    • Zone transition recording on portal crossings (lines 1579-1581)
    • Provider wiring for zones, people, positions (lines 1831-1863)
    • MQTT client integration for prediction publishing (lines 1846-1863)
    • Periodic prediction update loop every 60 seconds (lines 1866-1888)
    • Periodic prediction evaluation every 30 seconds (lines 1931-1983)
    • REST API endpoint registration (lines 2527-2888)

Constants and thresholds:

  • MinimumDataAge = 7 days (168 hours) before predictions activate
  • MinimumSamplesPerSlot = 3 observations per time slot
  • PredictionHorizon = 15 minutes (default)
  • MonteCarloRuns = 1000 simulations
  • TargetAccuracy = 75% at 15-minute horizon

Accuracy tracking:

  • Records predictions when made (personID, currentZone, predictedZone, confidence, horizon)
  • Evaluates pending predictions when target time is reached
  • Compares predicted zone vs actual zone
  • Computes rolling 7-day accuracy percentage
  • Reports "meets_target" when accuracy ≥ 75% and min predictions threshold met

Model learning:

  • Observations recorded every 5 minutes per person/zone
  • EMA update: p_new = p_old + α × (obs - p_old) where α = 0.03
  • Cold start: 7 days of data required for model readiness
  • Slot ready when sample_count ≥ 3
  • Automatic recomputation triggered on zone transitions

Files created/modified:

mothership/internal/prediction/
├── model.go           — ModelStore, transition probabilities, dwell times
├── predictor.go       — Predictor for presence prediction
├── horizon.go         — HorizonPredictor with Monte Carlo simulation
├── accuracy.go        — AccuracyTracker for prediction evaluation
├── history.go         — HistoryUpdater for zone transition recording
├── adapter.go         — Provider adapters for zones, people, positions
├── model_test.go      — Tests for model store operations
├── predictor_test.go  — Tests for prediction logic
├── accuracy_test.go   — Tests for accuracy tracking
└── horizon_test.go    — Tests for horizon predictions

mothership/internal/api/
├── prediction.go      — REST API handlers for predictions
└── prediction_test.go — Tests for prediction API endpoints

mothership/internal/mqtt/
└── client.go          — MQTT client with prediction sensor publishing

Acceptance criteria met:

  • Per-person transition probability tracking - Full implementation with Laplace smoothing
  • Per-zone occupancy patterns - Historical patterns with probability computation
  • Time-slot based predictions - Monte Carlo simulation at configurable horizons
  • HA sensor exposure for predicted states - Full auto-discovery with 3 sensors per person
  • >75% accuracy at 15-minute horizon - AccuracyTracker with rolling 7-day window

Phase 7 Status: COMPLETE

Phase 8 — Analysis & Developer Tools

Goal: Deep debugging, system tuning, and detection explainability.

Status: COMPLETE

Item Status Notes
Activity timeline (Component 27) Done Universal event stream with tap-to-time-travel
Detection explainability (Component 28) Done X-ray overlay, per-link contributions, BLE match details
Time-travel debugging Done Pause live, scrub timeline, parameter tuning overlay
Pre-deployment simulator Done Virtual space + nodes + walkers, GDOP overlay
CSI simulator (cmd/sim) Done Go CLI for hardware-free testing
Fresnel zone debug overlay Done Toggle wireframe ellipsoids in 3D scene

Implementation Summary

Activity timeline (internal/timeline/):

  • Storage subscribes to EventBus and writes events to SQLite asynchronously via buffered queue
  • Handles all event types: detections, zone transitions, alerts, system events, learning milestones
  • WebSocket push of new events to dashboard clients in real-time
  • REST API: GET /api/events with cursor-based pagination, filters (type/zone/person/time), and FTS5 search
  • Frontend: sidebar-timeline.js — virtualized list, tap-to-time-travel, inline feedback buttons

Detection explainability (internal/explainability/):

  • Handler maintains per-blob explanation data updated by the fusion engine
  • Per-link contribution table: deltaRMS, Fresnel zone number, learned weight, contribution amount
  • BLE match details: per-node RSSI, triangulation position, confidence
  • Fresnel zone ellipsoid geometry for 3D visualization
  • Frontend: explainability.js — X-ray overlay dims non-contributors, glowing contributing links

Time-travel debugging (internal/replay/):

  • Append-only csi_replay.bin with per-frame records (recv_time_ms + raw CSI binary)
  • Worker manages replay sessions: play/pause/seek/speed control
  • Parameter tuning: PATCH /api/replay/params re-runs pipeline on buffered data at max speed
  • "Apply to Live" copies tuned params to the running pipeline
  • Dashboard: timeline scrubber integrated with activity timeline events

Pre-deployment simulator (internal/simulator/):

  • Space defines room geometry with wall segments and material properties
  • NodeSet manages virtual TX/RX node placement
  • WalkerSet simulates random-walk or path-following persons
  • Two-ray propagation model with path loss + wall penetration + first-order reflections
  • GDOP computation per cell using Fisher information matrix
  • REST API at /api/simulator/* for space/node/walker management and GDOP computation

CSI simulator CLI (cmd/sim/):

  • Connects to mothership as virtual nodes, sends synthetic CSI binary frames
  • Walker random-walk model with Gaussian velocity updates, wall reflection
  • Amplitude/phase generated from propagation model with Gaussian noise injection
  • Optional BLE advertisement simulation (--ble flag)
  • Verified authentication (exits non-zero on {type:"reject"})
  • Integration test support: polls GET /api/blobs for blob count assertions

Fresnel zone debug overlay (dashboard/js/fresnel.js):

  • Toggle-able wireframe ellipsoids between active TX/RX link pairs
  • Ellipsoid geometry computed from TX/RX positions and Fresnel zone number
  • Color-coded by zone number (zone 1 = bright, outer zones = dimmer)
  • Toolbar button integration with existing layers panel

Files created/modified:

mothership/internal/timeline/       — timeline.go, timeline_test.go, handler.go, buffer_adapter.go
mothership/internal/explainability/ — handler.go
mothership/internal/replay/        — engine.go, engine_test.go, pipeline.go, pipeline_test.go,
                                     session.go, store.go, store_test.go, types.go, worker.go
mothership/internal/simulator/     — accuracy.go, engine.go, gdop.go, handler.go, node.go,
                                     physics.go, propagation.go, registry_bridge.go, session.go,
                                     space.go, virtual_state.go, walker.go + test files
mothership/cmd/sim/                 — main.go, generator.go, verify.go, walker.go, main_test.go
mothership/internal/api/            — replay.go, replay_test.go, simulator.go
dashboard/js/                       — explainability.js, replay.js, fresnel.js, sidebar-timeline.js

Phase 8 Status: COMPLETE

Phase 9 — UX Polish & Accessibility

Goal: Accessible to every household member. Power user efficiency. Always-on ambient display.

Status: COMPLETE

Item Status Notes
Simple mode (progressive disclosure) Done Card-based mobile-first UI, room cards, activity feed
Ambient dashboard mode (Component 31) Done /ambient route, Canvas 2D, time-of-day palette, auto-dim
Spatial quick actions (Component 32) Done Right-click / long-press context menus on 3D elements
Command palette (Component 34) Done Ctrl+K / Cmd+K, fuzzy search, navigate time, execute commands
Morning briefing (Component 35) Done Daily summary card on first open, push notification support
Guided troubleshooting (Component 36) Done Proactive contextual help, dismissible, never repeats
Mobile-responsive expert mode Done Touch orbit/pan/zoom, hamburger menu, FXAA on mobile
Fleet status page Done Full table with OTA progress, bulk actions, camera fly-to

Implementation Summary

Simple mode (dashboard/simple.html, dashboard/js/simple.js):

  • Card-based layout: one room card per zone with occupancy count and person names
  • Activity feed as chronological event list from timeline REST API
  • Alert banner for fall detection, anomaly alerts, system warnings
  • Sleep summary card for morning view
  • No 3D scene — designed for non-technical household members
  • Toggle button in toolbar; per-user default stored in localStorage

Ambient dashboard (dashboard/ambient.html, dashboard/js/ambient.js):

  • Served at /ambient — separate lightweight route for wall-mounted tablets
  • Canvas 2D renderer: colored circles for people, zone labels, soft glow effects
  • Time-of-day palette: morning (cool), day (neutral), evening (amber), night (very dim)
  • Auto-dim when house empty for 30+ min; gentle fade-in on person detection
  • Alert mode: pulsing red border + large text + action buttons on fall/security events
  • Morning briefing integration: briefing text shown on first detection, fades after 30 s
  • Reconnect backoff handles WebSocket drops gracefully

Spatial quick actions (dashboard/js/quick-actions.js):

  • Three.js Raycaster determines target under cursor (person/node/zone/portal/trigger/empty)
  • Context menu component renders appropriate options per target type
  • Per-blob: "Who is this?", "Why?", "Follow" camera, "Create automation", "Mark incorrect"
  • Per-node: "Diagnostics", "Blink LED", "Reposition", "Update firmware", "Show links"
  • Per-empty: "What happened here?", "Add trigger zone", "Add virtual node", "Coverage quality"
  • Per-zone: "Zone history", "Edit zone", "Create automation", "Crowd flow"
  • "Follow" mode: camera smoothly tracks person, auto-orbiting to keep them centered

Command palette (dashboard/js/command-palette.js):

  • Ctrl+K (Cmd+K on Mac) opens universal search and command interface
  • Fuzzy matching across zones, persons, nodes, settings, help topics, events
  • Navigate time: "last night 2am", "yesterday kitchen", "this morning"
  • Execute commands: "update all nodes", "re-baseline kitchen", "arm security"
  • Help: "help fall detection", "why false positive", "troubleshoot kitchen"
  • Recently used commands surface first; expert mode only

Morning briefing (internal/briefing/, dashboard/js/briefing.js):

  • Generator assembles briefing in priority order from sleep, events, anomalies, system health
  • Priority blocks: critical alerts → sleep summary → who is home → overnight anomalies → system health → predictions → learning progress
  • Degenerate case: "All quiet last night. All systems healthy."
  • Stored in briefings SQLite table (one per day per person)
  • REST API: GET /api/briefing, GET /api/briefing/current
  • Dashboard: card overlay on first open, dismissible, slides away after 10 s

Guided troubleshooting (internal/guidedtroubleshoot/, dashboard/js/troubleshoot.js):

  • Trigger conditions: detection quality drops, repeated setting changes, node offline >2 h
  • Repeated-edit detection: per-key counter in memory; hint delivered in GET /api/settings response as "repeated_edit_hint": true
  • Proactive diagnostic flow: check connectivity → show link health → suggest repositioning → offer re-baseline
  • First-time feature tooltips shown once, dismissed on click, stored in localStorage
  • Post-feedback explanations in timeline after incorrect/missed detection feedback

Mobile-responsive expert mode (dashboard/js/mobile.js + CSS):

  • Touch orbit (one finger), pan (two fingers), pinch-zoom (two fingers)
  • FXAA anti-aliasing replaces MSAA on mobile (better performance on low-power GPUs)
  • Hamburger menu for toolbar panels on small screens
  • Viewport meta tag with viewport-fit=cover for notch-aware layout
  • CSS Grid layout collapses gracefully on narrow viewports

Fleet status page (dashboard/fleet.html, dashboard/js/fleet-page.js):

  • Full table with sortable columns: Name, MAC, Role, Position (fly-to), Firmware, RSSI, Status, Uptime, Actions
  • OTA progress bar per node during updates (PENDING → DOWNLOADING → REBOOTING → VERIFIED / FAILED)
  • Bulk actions: Update All (rolling OTA), Re-baseline All, Export Config, Import Config
  • Camera fly-to: clicking position coordinates in table jumps 3D camera to that node
  • Responsive layout works on both desktop and tablet

Files created/modified:

dashboard/simple.html               — Simple mode page
dashboard/ambient.html              — Ambient dashboard page
dashboard/fleet.html                — Fleet status page
dashboard/js/simple.js              — Simple mode WebSocket + card rendering
dashboard/js/simplemode.js          — Simple mode toggle and state management
dashboard/js/ambient.js             — Ambient dashboard controller
dashboard/js/ambient_renderer.js    — Canvas 2D renderer with time-of-day palette
dashboard/js/ambient_briefing.js    — Morning briefing integration for ambient
dashboard/js/quick-actions.js       — Context menu for 3D scene elements
dashboard/js/command-palette.js     — Universal search and command interface
dashboard/js/briefing.js            — Morning briefing card overlay
dashboard/js/troubleshoot.js        — Guided troubleshooting UI
dashboard/js/guided-help.js         — First-time feature discovery tooltips
dashboard/js/mobile.js              — Mobile touch controls and FXAA
dashboard/js/fleet-page.js          — Fleet status table and bulk actions
mothership/internal/briefing/       — briefing.go, briefing_test.go, scheduler.go,
                                     dashboard_adapter.go, notify_adapter.go
mothership/internal/guidedtroubleshoot/ — discovery.go, notifier.go, quality.go,
                                          linkweather.go, reposition.go, alert_handler.go
mothership/internal/api/            — briefing.go, briefing_test.go, guided.go

Phase 9 Status: COMPLETE