jedarden/zai-proxy
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
ZAI LLM reverse proxy and metrics dashboard
11 commits 1 branch 0 tags 11 MiB
Go 59.1%
Shell 20%
TypeScript 11.2%
Python 8.7%
CSS 0.5%
Other 0.4%
Find a file
jedarden 36727ac66d docs(plan): mark migration checklist complete 
All migration items completed:
- Workflow templates pushed to declarative-config (May 17)
- Documentation updated to point to new repo (ardenone-cluster commit 79b9a9cf8)
- Old container directories retired (ardenone-cluster commit 4b4468842)

The zai-proxy project now lives at git.ardenone.com/jedarden/zai-proxy
with CI/CD workflow templates deployed via ArgoCD.

Note: Commit pending push due to Forgejo network connectivity issue.
Bead-Id: bf-4a2
2026-06-21 10:38:46 -04:00
dashboard docs(dashboard): add comprehensive README.md 2026-06-21 09:56:17 -04:00
docs docs(plan): mark migration checklist complete 2026-06-21 10:38:46 -04:00
notes docs(plan): mark migration checklist complete 2026-06-21 10:38:46 -04:00
proxy chore: update module paths and add evaluation package 2026-05-16 16:03:50 -04:00
.gitignore feat: initial zai-proxy ecosystem repo 2026-05-16 15:53:52 -04:00
CONTRIBUTING.md docs: add comprehensive CONTRIBUTING.md 2026-06-21 10:02:17 -04:00
DEVELOPMENT.md docs: add comprehensive DEVELOPMENT.md developer guide 2026-06-21 10:05:18 -04:00
README.md feat: initial zai-proxy ecosystem repo 2026-05-16 15:53:52 -04:00

README.md

zai-proxy

LLM reverse proxy and metrics dashboard for the Z.AI API.

Components

proxy/

OpenAI-compatible reverse proxy that fronts the Z.AI API. Features:

  • Request/response body parsing and token counting (tiktoken + GLM tokenizers)
  • Rate limiting with configurable burst and steady-state limits
  • Prometheus metrics export
  • Blue/green and canary deployment support
  • Translation layer for provider-specific request/response formats

See proxy/README.md for setup and configuration.

dashboard/

Go backend + React frontend for visualizing proxy metrics, token usage, and request history.

  • Collects metrics from the proxy's Prometheus endpoint
  • Stores aggregated data in SQLite
  • Serves a Tailwind/Vite frontend via SSE for live updates

See dashboard docs for deployment and monitoring.

Docs

  • docs/plan/ — architecture decisions and roadmaps
  • docs/notes/ — deployment, operations, monitoring, canary procedures
  • docs/research/ — tokenizer research, metrics references

Git remotes

  • Forgejo (primary): https://git.ardenone.com/jedarden/zai-proxy.git