THE SUZENT HANDBOOK
LiteLLM Proxy
Route Suzent through your own LiteLLM proxy for shared keys, rate limits, and cost tracking.
If you already run a LiteLLM proxy in front of your models, for example to share keys across a team or track spending, Suzent can use it like any other provider.
Set up
- Start your LiteLLM proxy and note its URL and master key.
- Open Settings → Providers. Under Add a provider, find LiteLLM Proxy (or type its name in the search box) and click it to open its card.
- On the API keys tab, fill in Base URL and Master Key, clicking Save for each.
- Click Test connection to load the models your proxy exposes, then tick the ones you want on the Models tab.
Changes save on their own.
Settings
| Field | Environment variable | Notes |
|---|---|---|
| Master Key | LITELLM_MASTER_KEY | LITELLM_PROXY_API_KEY also works. |
| Base URL | LITELLM_BASE_URL | For example http://localhost:4000. |
You can set these environment variables before starting Suzent instead of typing the values in. Settings then marks the value Environment. A value you save in the app takes priority over it.