SUZENT / 文档
SUZENT 使用手册

vLLM

Connect Suzent to models you serve yourself with vLLM.

此页面目前提供英文内容,中文翻译尚未完成。

If you serve models yourself with vLLM, on your own computer or a server you control, Suzent can talk to it directly.

Set up

  1. Start the vLLM server with an OpenAI-compatible API.
  2. Open Settings → Providers. Under Add a provider, find vLLM (or type its name in the search box) and click it to open its card.
  3. On the API keys tab, enter the server's Base URL and click Save.
  4. Click Test connection, then tick the models you want on the Models tab.

Changes save on their own.

Settings

FieldEnvironment variableNotes
Base URLVLLM_BASE_URLDefaults to http://127.0.0.1:8000/v1.
API Key (Optional)VLLM_API_KEYOnly if you started the server with an API key.

You can set these environment variables before starting Suzent instead of typing the values in. Settings then marks the value Environment. A value you save in the app takes priority over it.

在 GitHub 上编辑此页 ↗

本页内容