| title | Architecture |
|---|---|
| nav_order | 2 |
| has_children | true |
Understanding the LLM Proxy system design and architecture.
- Architecture Overview - System design, components, and data flow
- Brownfield Architecture - Current implementation state and technical reality
- Proxy Design Decisions - Design rationale for the transparent proxy
- Technical Debt Register - Known issues and improvement plans
- Code Organization - Package structure and module organization
The LLM Proxy is a transparent reverse proxy that:
- Replaces short-lived "withering" tokens with real API keys
- Provides project-based access control
- Publishes async events for observability
- Caches HTTP responses for efficiency
For the complete system design, see the Architecture Overview.