AI Models with Streaming Support
This page lists Large Language Models that offer Streaming. Compare models, see how they implement this feature, and find the best option for projects requiring robust Streaming.
Providers
Models with this Capability
Claude Sonnet 3.7
Anthropic · Claude 3
ID: claude-3-7-sonnet-20250219
Input
200K tokens
Output
64K tokens
Input Cost
$3.00/1M
Output Cost
$15.00/1M
Exceptional at:
GPT-4.1 nano
OpenAI · GPT-4.1
ID: gpt-4.1-nano
Input
1.0M tokens
Output
32.8K tokens
Input Cost
$0.10/1M
Output Cost
$0.40/1M
Exceptional at:
Claude 3.5 Haiku
Anthropic · Claude 3.5
ID: anthropic-claude-3-5-haiku
Input
200K tokens
Output
8.2K tokens
Input Cost
$0.80/1M
Output Cost
$4.00/1M
Exceptional at:
Claude 3.5 Sonnet
Anthropic · Claude
ID: anthropic-claude-3-5-sonnet
Input
200K tokens
Output
4.1K tokens
Input Cost
$3.00/1M
Output Cost
$15.00/1M
Exceptional at:
Claude 3.5 Sonnet
Anthropic · Claude
ID: claude-3-5-sonnet-20241022
Input
200K tokens
Output
8.2K tokens
Input Cost
$3.00/1M
Output Cost
$15.00/1M
o1-mini
OpenAI · o1
ID: o1-mini
Input
128K tokens
Output
65.5K tokens
Input Cost
$1.10/1M
Output Cost
$4.40/1M
Exceptional at:
GPT-3.5 Turbo
OpenAI · GPT-3.5
ID: gpt-3.5-turbo-1106
Input
16.4K tokens
Output
4.1K tokens
Input Cost
$0.50/1M
Output Cost
$1.50/1M
GPT-4 Turbo
OpenAI · GPT-4
ID: gpt-4-turbo
Input
128K tokens
Output
4.1K tokens
Input Cost
$10.00/1M
Output Cost
$30.00/1M
Exceptional at:
GPT-4o
OpenAI · GPT-4o
ID: gpt-4o-2024-05-13
Input
128K tokens
Output
16.4K tokens
Input Cost
$2.50/1M
Output Cost
$10.00/1M
Exceptional at:
GPT-4o
OpenAI · GPT-4o
ID: gpt-4o-2024-11-20
Input
128K tokens
Output
16.4K tokens
Input Cost
$2.50/1M
Output Cost
$10.00/1M
Exceptional at:
ChatGPT-4o
OpenAI · GPT-4o
ID: chatgpt-4o
Input
128K tokens
Output
4.1K tokens
Input Cost
$5.00/1M
Output Cost
$15.00/1M
Exceptional at:
GPT-4
OpenAI · GPT-4
ID: gpt-4-0613
Input
8.2K tokens
Output
8.2K tokens
Input Cost
$30.00/1M
Output Cost
$60.00/1M
Exceptional at:
GPT-4o mini
OpenAI · GPT-4o
ID: gpt-4o-mini
Input
128K tokens
Output
16.4K tokens
Input Cost
$0.15/1M
Output Cost
$0.60/1M
Exceptional at:
o3-2025-04-16
OpenAI · o3
ID: o3-2025-04-16
Input
200K tokens
Output
100K tokens
Input Cost
$10.00/1M
Output Cost
$40.00/1M
Exceptional at:
o3
OpenAI · OpenAI
ID: o3
Input
200K tokens
Output
100K tokens
Input Cost
$10.00/1M
Output Cost
$40.00/1M
Exceptional at:
GPT-4o
OpenAI · GPT-4o
ID: gpt-4o
Input
128K tokens
Output
16.4K tokens
Input Cost
$2.50/1M
Output Cost
$10.00/1M
Exceptional at:
GPT-4o Audio
OpenAI · GPT-4o
ID: gpt-4o-audio-preview
Input
128K tokens
Output
16.4K tokens
Input Cost
$2.50/1M
Output Cost
$10.00/1M
Exceptional at:
GPT-3.5 Turbo
OpenAI · GPT-3.5
ID: gpt-3.5-turbo
Input
16.4K tokens
Output
4.1K tokens
Input Cost
$0.50/1M
Output Cost
$1.50/1M
Exceptional at:
GPT-4.1 mini
OpenAI · GPT-4.1
ID: gpt-4.1-mini
Input
1.0M tokens
Output
32.8K tokens
Input Cost
$0.40/1M
Output Cost
$1.60/1M
Claude 3.5 Sonnet
Anthropic · Claude
ID: claude-3-5-sonnet-latest
Input
200K tokens
Output
8.2K tokens
Input Cost
$3.00/1M
Output Cost
$15.00/1M
Claude 3.7 Sonnet
Anthropic · Claude 3
ID: anthropic-claude-3-7-sonnet
Input
200K tokens
Output
4.1K tokens
Input Cost
$3.00/1M
Output Cost
$15.00/1M
Exceptional at:
GPT-4o
OpenAI · GPT-4o
ID: gpt-4o-2024-08-06
Input
128K tokens
Output
16.4K tokens
Input Cost
$2.50/1M
Output Cost
$10.00/1M
Exceptional at:
GPT-4
OpenAI · GPT-4
ID: gpt-4
Input
8.2K tokens
Output
8.2K tokens
Input Cost
$30.00/1M
Output Cost
$60.00/1M
Exceptional at:
o1
OpenAI · o-series
ID: o1
Input
200K tokens
Output
100K tokens
Input Cost
$15.00/1M
Output Cost
$60.00/1M
Exceptional at:
Claude Haiku 3.5
Anthropic · Claude
ID: claude-3-5-haiku-latest
Input
200K tokens
Output
8.2K tokens
Input Cost
$0.80/1M
Output Cost
$4.00/1M
Exceptional at:
o4-mini
OpenAI · o-series
ID: o4-mini
Input
200K tokens
Output
100K tokens
Input Cost
$1.10/1M
Output Cost
$4.40/1M
Exceptional at:
GPT-4.1
OpenAI · GPT-4.1
ID: gpt-4.1
Input
1.0M tokens
Output
32.8K tokens
Input Cost
$2.00/1M
Output Cost
$8.00/1M
Exceptional at:
o3-mini
OpenAI · o3
ID: o3-mini
Input
200K tokens
Output
100K tokens
Input Cost
$1.10/1M
Output Cost
$4.40/1M
Exceptional at:
GPT-4o mini Audio
OpenAI · GPT-4o
ID: gpt-4o-mini-audio-preview
Input
128K tokens
Output
16.4K tokens
Input Cost
$0.15/1M
Output Cost
$0.60/1M
Exceptional at:
Claude Opus 3
Anthropic · Claude 3
ID: claude-3-opus-latest
Input
200K tokens
Output
4.1K tokens
Input Cost
$15.00/1M
Output Cost
$75.00/1M
Exceptional at:
Similar Capabilities
Multimodal Input
Found in 22 models with Streaming
Long Context
Found in 15 models with Streaming
Vision
Found in 13 models with Streaming
Function Calling
Found in 25 models with Streaming
Extended Thinking
Found in 2 models with Streaming
Prompt Caching
Found in 8 models with Streaming