Skip to main content

LiteLLM Proxy

Run a self-hosted gateway in front of any set of models. Useful for teams, rate-limit management, or cost tracking.

Setup: docs.litellm.ai

FieldDescription
LITELLM_MASTER_KEYYour proxy master key (starts with sk-...)
LITELLM_BASE_URLURL of your running proxy (e.g. http://localhost:4000)

Click Fetch Models after saving to load the models your proxy exposes.