SUZENT / DocsTHE SUZENT HANDBOOK
LiteLLM Proxy
Run a self-hosted gateway in front of any set of models. Useful for teams, rate-limit management, or cost tracking. Setup: docs.litellm.ai Field Description --- --- LITELLM_MASTER_
Run a self-hosted gateway in front of any set of models. Useful for teams, rate-limit management, or cost tracking.
Setup: docs.litellm.ai
| Field | Description |
|---|---|
LITELLM_MASTER_KEY | Your proxy master key (starts with sk-...) |
LITELLM_BASE_URL | URL of your running proxy (e.g. http://localhost:4000) |
Click Fetch Models after saving to load the models your proxy exposes.