Connect a provider
Add an LLM or embedding provider configuration, including custom OpenAI-compatible endpoints.
Providers are configured once per scope (organization or project) and then reused by any number of agents or knowledge bases.
1. Open the providers screen
Go to Project → Settings → Providers → New Provider.
2. Choose a provider type
| Provider | Model field example |
|---|---|
| OpenAI | gpt-4o |
| Anthropic | claude-sonnet-4-5 |
| Google Gemini | gemini-2.0-flash |
| Ollama | llama3.1 |
| Azure OpenAI | gpt-4o (+ deployment name) |
| Custom (OpenAI-compatible) | any model name your endpoint serves |
3. Enter the API key
The key is submitted once and immediately encrypted. It is never returned by any API response afterward — if you need to verify a key is correct, use the test endpoint rather than trying to view it.
4. For custom/self-hosted endpoints
Selecting Custom reveals a Base URL field. This is how you connect a self-hosted or any other OpenAI-compatible endpoint — set the base URL to your endpoint and choose the model name it serves.
5. Test the connection
POST /api/v1/providers/{id}/testThis performs a lightweight completion/embedding call to confirm the provider is reachable and the key is valid, without exposing the key itself.
6. Use it
The provider now appears in the selector when creating or editing agents (for chat models) and knowledge bases (for embedding models) — the same consistent selection experience is used for both.