Large Language Models

List LLMs for text summarization, chat, and other generation tasks.

📄️Create an LLM

Creates a connection to an external Large Language Model (LLM) for Retrieval Augmented Generation (RAG) and chat. You can connect OpenAI API-compatible models from providers like Anthropic, Azure, Google, or custom-hosted endpoints. After creation, reference your custom LLM by name in query generation parameters.

📄️List LLMs

Lists LLMs that you can use with query and chat endpoints. A query does not specify the LLM directly. Instead, it uses a `generation_preset_name`. The `generation_preset_name` in generation parameters corresponds to the `name` property of the generation presets that `/v2/generation_presets` lists.

📄️Get an LLM

Returns the details of a Large Language Model (LLM) configured within the platform. The details include the name, description, model type, API endpoint, and authentication method.

📄️Delete an LLM

Deletes a custom Large Language Model (LLM) configuration from the account. The deletion is permanent. Built-in LLMs cannot be deleted, so core system models remain accessible.

📄️Update an LLM

Updates an existing LLM's configuration. This endpoint supports partial updates. Provide only the fields you want to change. Only the name field is immutable.