Skip to main content
Version: 2.0

Large Language Models (LLMs) API Definition

The Large Language Models (LLMs) API retrieves a list of available LLMs that can be used with query and chat endpoints.

Large Language Models (LLMs) Request and Response​

To list the available LLMs, send a GET request to /v2/llms. You can specify optional query parameters to filter the results.

  • filter - Specifies a regular expression to match against the names and descriptions of the LLMs.
  • limit - Indicates the maximum number of LLMs to return in a single request, with a default value of 10 and a maximum value of 100.
  • page_key - Indicates the next page of results when the previous request has reached the limit.

REST 2.0 URL​

Large Language Models (LLMs) Endpoint Address​

Vectara exposes an HTTP endpoint at the following URL to list LLMs:
https://api.vectara.io/v2/llms

The API Reference shows the full Large Language Models (LLMs) REST definition.