GPT-4o - In-Depth Overview

OpenAI · GPT-4o

outdated

Flagship

Model ID: gpt-4o-2024-05-13

Get all the details on GPT-4o, an AI model from OpenAI. This page covers its token limits, pricing structure, key capabilities such as multimodal_input, function_calling, structured_outputs, available API code samples, and performance strengths.

Key Metrics

Input Limit

128K tokens

Output Limit

16.4K tokens

Input Cost

$2.50/1M

Output Cost

$10.00/1M

Sample API Code

from openai import OpenAI;client = OpenAI();response = client.chat.completions.create(model='gpt-4o-2024-05-13',messages=[{'role': 'system', 'content': 'You are a helpful assistant.'},{'role': 'user', 'content': 'Hello!'}]);print(response.choices[0].message.content)

Required Libraries

openai

Benchmarks

Benchmark	Score	Source	Notes
lmarena text	1282	Open LLM Leaderboard	-
lmarena vision	1206	Open LLM Leaderboard	-
lmarena search	1000	Open LLM Leaderboard	Score for api-gpt-4o-search, a search-optimized variant of GPT-4o.
bfcl	72.08%	Vellum LLM Leaderboard	-
aime 2024	13.4%	Vellum LLM Leaderboard	-
gpqa	56.1%	Vellum LLM Leaderboard	-
swe bench	31%	Vellum LLM Leaderboard	-
math 500	60.3%	Vellum LLM Leaderboard	-
alder polyglot	27.1%	Vellum LLM Leaderboard	-
livebench global average	53.95	LiveBench	-
livebench reasoning average	39.75	LiveBench	-
livebench coding average	69.29	LiveBench	-
livebench mathematics average	41.48	LiveBench	-
livebench data analysis average	63.53	LiveBench	-
livebench language average	44.68	LiveBench	-
livebench if average	64.94	LiveBench	-

Notes

GPT-4o (“o” for “omni”) is OpenAI's versatile, high-intelligence flagship model. It accepts both text and image inputs, and produces text outputs (including Structured Outputs). It is the best model for most tasks, and is the most capable model outside of the o-series models.