> ## Documentation Index
> Fetch the complete documentation index at: https://assemblyai.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.
# List available models
>
To use our EU server for LLM Gateway, replace `llm-gateway.assemblyai.com` with `llm-gateway.eu.assemblyai.com`.
Returns the list of models available through LLM Gateway, including the supported parameters, context length, pricing, and regional availability of each model. This endpoint doesn't require authentication.
## OpenAPI
````yaml api-reference/specs/llm-gateway.yaml GET /models
openapi: 3.1.0
info:
title: AAI Chat Completions API
description: API for generating text with various language models.
version: 1.0.0
servers:
- url: https://llm-gateway.assemblyai.com/v1
description: Production Server
x-fern-server-name: Production
security:
- ApiKey: []
paths:
/models:
get:
summary: List available models
description: >-
To use our EU server for LLM Gateway, replace
`llm-gateway.assemblyai.com` with
`llm-gateway.eu.assemblyai.com`.
Returns the list of models available through LLM Gateway, including the
supported parameters, context length, pricing, and regional availability
of each model. This endpoint doesn't require authentication.
operationId: listAvailableModels
responses:
'200':
description: Successful response containing the list of available models.
content:
application/json:
schema:
$ref: '#/components/schemas/ListAvailableModelsResponse'
examples:
models_example:
summary: List of available models
value:
data:
- id: qwen3.5-4b-32k-fast
name: Qwen3.5 4B Fast
description: ''
creator: Qwen
context_length: 32768
supported_parameters:
- max_tokens
- temperature
- stream
default_parameters:
temperature: null
top_p: null
frequency_penalty: null
top_provider:
is_moderated: false
context_length: 32768
max_completion_tokens: 8192
pricing:
global:
prompt: 0.1
completions: 0.5
retirement_date: 0
available_regions:
- us
- eu
- id: claude-sonnet-4-6
name: Sonnet 4.6
description: ''
creator: Claude
context_length: 200000
supported_parameters:
- max_tokens
- temperature
- tools
- tool_choice
- response_format
- stream
default_parameters:
temperature: null
top_p: null
frequency_penalty: null
top_provider:
is_moderated: false
context_length: 200000
max_completion_tokens: 128000
pricing:
global:
prompt: 3
completions: 15
input_cache_read: 0.3
input_cache_write: 3.75
input_cache_write_1h: 6
regional_increase_percent: 0.1
retirement_date: 0
available_regions:
- us
- eu
- global
- id: gemini-2.5-flash-lite
name: Gemini 2.5 Flash Lite
description: ''
creator: Google
context_length: 1048576
supported_parameters:
- max_tokens
- response_format
- temperature
- tools
- tool_choice
- stream
default_parameters:
temperature: null
top_p: null
frequency_penalty: null
top_provider:
is_moderated: false
context_length: 1048576
max_completion_tokens: 65535
pricing:
global:
prompt: 0.1
completions: 0.4
input_cache_read: 0.01
regional_increase_percent: 0.1
retirement_date: 0
available_regions:
- us
- eu
- global
default:
description: An unexpected error occurred.
content:
application/json:
schema:
$ref: '#/components/schemas/ErrorResponse'
security: []
components:
schemas:
ListAvailableModelsResponse:
type: object
description: The response returned by the models endpoint.
properties:
data:
type: array
items:
$ref: '#/components/schemas/ModelDetails'
description: The list of models available through LLM Gateway.
required:
- data
ErrorResponse:
type: object
properties:
code:
type: integer
format: int32
description: HTTP status code for the error.
message:
type: string
description: A human-readable description of the error.
request_id:
type: string
format: uuid
description: Unique identifier for the request.
metadata:
type: object
description: >-
Optional. Present on 400 responses with per-field validation
details.
properties:
errors:
type: array
items:
type: string
description: List of specific validation failure messages.
required:
- code
- message
- request_id
ModelDetails:
type: object
description: Details about a model available through LLM Gateway.
properties:
id:
type: string
description: >-
The model ID. Use this value in the `model` field of a chat
completion request.
examples:
- qwen3.5-4b-32k-fast
name:
type: string
description: The human-readable name of the model.
examples:
- Qwen3.5 4B Fast
description:
type: string
description: A description of the model.
creator:
type: string
description: The creator of the model.
examples:
- Qwen
context_length:
type: integer
description: The maximum context length of the model, in tokens.
examples:
- 32768
supported_parameters:
type: array
items:
type: string
description: >-
The request parameters and features supported by the model (e.g.,
`max_tokens`, `temperature`, `tools`, `tool_choice`,
`response_format`, `stream`).
default_parameters:
$ref: '#/components/schemas/DefaultParameters'
description: >-
Default parameter values applied to requests for this model. A
`null` value means no default is set.
top_provider:
$ref: '#/components/schemas/TopProvider'
description: >-
Information about the best provider for this model. Not yet
supported.
pricing:
$ref: '#/components/schemas/ModelPricing'
description: Pricing details for the model, in USD per 1 million tokens.
retirement_date:
type: integer
format: int64
description: >-
The Unix timestamp of the model's retirement date. `0` if no
retirement date is set.
available_regions:
type: array
items:
type: string
description: >-
The regions where the model is available (`us`, `eu`, and/or
`global`). See [Cloud endpoints & data
residency](https://www.assemblyai.com/docs/llm-gateway/cloud-endpoints-and-data-residency)
for more details.
DefaultParameters:
type: object
description: >-
Default parameter values applied to requests for this model. A `null`
value means no default is set.
properties:
temperature:
type: number
format: float
nullable: true
description: The default temperature for this model, if any.
top_p:
type: number
format: float
nullable: true
description: The default top_p for this model, if any.
frequency_penalty:
type: integer
nullable: true
description: The default frequency penalty for this model, if any.
TopProvider:
type: object
description: Information about the best provider for this model. Not yet supported.
properties:
is_moderated:
type: boolean
description: Whether the provider moderates requests.
context_length:
type: integer
description: The maximum context length supported by the provider, in tokens.
max_completion_tokens:
type: integer
description: The maximum number of completion tokens supported by the provider.
ModelPricing:
type: object
description: Pricing details for the model, in USD per 1 million tokens.
properties:
global:
$ref: '#/components/schemas/ModelPricingData'
description: >-
Pricing for global processing. See [Global
routing](https://www.assemblyai.com/docs/llm-gateway/cloud-endpoints-and-data-residency#global-routing)
for more details.
us:
$ref: '#/components/schemas/ModelPricingData'
description: >-
US-specific pricing. Only present when the model has pricing
distinct from global pricing in the US region.
eu:
$ref: '#/components/schemas/ModelPricingData'
description: >-
EU-specific pricing. Only present when the model has pricing
distinct from global pricing in the EU region.
regional_increase_percent:
type: number
format: float
description: >-
The fractional price increase applied to in-region (US or EU)
processing relative to global pricing (e.g., `0.1` means 10%).
required:
- global
ModelPricingData:
type: object
description: Prices in USD per 1 million tokens.
properties:
prompt:
type: number
format: float
description: The price per 1 million input (prompt) tokens.
completions:
type: number
format: float
description: The price per 1 million output (completion) tokens.
input_cache_read:
type: number
format: float
description: >-
The price per 1 million cached input tokens read. Only present for
models that support prompt caching.
input_cache_write:
type: number
format: float
description: >-
The price per 1 million input tokens written to the cache. Only
present for models that support prompt caching.
input_cache_write_1h:
type: number
format: float
description: >-
The price per 1 million input tokens written to the cache with a
1-hour TTL. Only present for models that support prompt caching.
securitySchemes:
ApiKey:
type: apiKey
in: header
name: Authorization
````