ZAI LLM reverse proxy and metrics dashboard
- Document all 5 API endpoints: /healthz, /api/config, /api/status, /api/metrics, /api/events - Include request parameters, response schemas, and example curl commands - Document SSE event types and format with code examples in JavaScript and Go - Add data retention policies, CORS information, and browser usage guidance - Link to related documentation Co-Authored-By: Claude <noreply@anthropic.com> Bead-Id: bf-4rx |
||
|---|---|---|
| dashboard | ||
| docs | ||
| proxy | ||
| .gitignore | ||
| README.md | ||
zai-proxy
LLM reverse proxy and metrics dashboard for the Z.AI API.
Components
proxy/
OpenAI-compatible reverse proxy that fronts the Z.AI API. Features:
- Request/response body parsing and token counting (tiktoken + GLM tokenizers)
- Rate limiting with configurable burst and steady-state limits
- Prometheus metrics export
- Blue/green and canary deployment support
- Translation layer for provider-specific request/response formats
See proxy/README.md for setup and configuration.
dashboard/
Go backend + React frontend for visualizing proxy metrics, token usage, and request history.
- Collects metrics from the proxy's Prometheus endpoint
- Stores aggregated data in SQLite
- Serves a Tailwind/Vite frontend via SSE for live updates
See dashboard docs for deployment and monitoring.
Docs
docs/plan/— architecture decisions and roadmapsdocs/notes/— deployment, operations, monitoring, canary proceduresdocs/research/— tokenizer research, metrics references
Git remotes
- Forgejo (primary):
https://git.ardenone.com/jedarden/zai-proxy.git