LLM Service Provider

Default Models

Default models are the published models for this provider. If you need to use a model that isn't in this list, create a custom model.

Custom Models

Custom models are specific to this provider type and are available to all providers of the same type.

Base URL path for API requests. Leave blank for the default API endpoint.
This allows you to specify which OpenAI organization to use for your API requests if you belong to multiple organizations. It is not required if you only belong to one organization or want to use your default organization.
Base URL path for API requests e.g. 'https://.openai.azure.com/'
API Version e.g. '2023-05-15'
Base URL path for API requests e.g. 'https://api.anthropic.com'

Create a new Custom Model

The name of the model. e.g. 'gpt-4o-mini' or 'claude-3-5-sonnet-20240620'
When the message history for a session exceeds this limit (in tokens), it will be compressed. If 0, compression will be disabled which may result in errors or high LLM costs.