List generation presets

GET 
/v2/generation_presets

Lists the generation presets used for query requests. The platform creates and maintains predefined generation presets. A generation preset groups several properties that configure generation for a request. This includes the prompt_template, the Large Language Model (LLM), and other generation settings like max_tokens and temperature. Each preset includes a complete Velocity template for the prompt. Presets are typically associated with a single LLM.

Specify a generation preset in query or chat requests with the generation_preset_name field.

Generation presets object

The generation_presets object contains the name, description, llm_name, prompt_template, and other fields that make up the preset.

If your account has access to a preset, enabled is set to true. A preset can also be set as a default.

Example generation presets response

{
  "generation_presets": [
    {
      "name": "vectara-summary-ext-24-05-med-omni",
      "description": "Generate summary with controllable citations, Uses GPT-4o with 2,048 max tokens",
      "llm_name": "gpt-4o",
      "prompt_template": "[\n    {\"role\": \"system\", \"content\": \"Follow these detailed step-by-step",
      "max_used_search_results": 25,
      "max_tokens": 2048,
      "temperature": 0,
      "frequency_penalty": 0,
      "presence_penalty": 0,
      "enabled": true,
      "default": false
    }
  ]
}

Request

Responses

200

List of Generation Presets.

403

Permissions do not allow listing generation presets.