Evalry
All models

OpenAI: GPT-4o (2024-08-06)

by OpenAI

The 2024-08-06 version of GPT-4o offers improved performance in structured outputs, with the ability to supply a JSON schema in the respone_format. Read more [here](https://openai.com/index/introducing-structured-outputs-in-the-api/). GPT-4o ("o" for "omni") is OpenAI's latest AI model, supporting both text and image inputs with text outputs. It maintains the intelligence level of [GPT-4 Turbo](/models/openai/gpt-4-turbo) while being twice as fast and 50% more cost-effective. GPT-4o also offers improved performance in processing non-English languages and enhanced visual capabilities. For benchmarking against other models, it was briefly called ["im-also-a-good-gpt2-chatbot"](https://twitter.com/LiamFedus/status/1790064963966370209)

Avg Score

0.0%

0 answers

Avg Latency

0ms

0 runs

Pricing

$2.50

input

/

$10.00

output

per 1M tokens

Context

128K

tokens

Alternatives

Models with similar or better quality but different tradeoffs

No alternatives found

Run benchmarks on this model to discover alternatives

Other Models from OpenAI

Compare performance with other models from the same creator

ModelScoreLatencyCost/1M
OpenAI: GPT-5.287.1%4.9s$7.88
OpenAI: GPT-5.2 Pro85.5%18.4s$94.50
OpenAI: GPT-5.2 Chat84.9%4.2s$7.88
OpenAI: GPT-5 Mini80.1%8.9s$1.13
OpenAI: GPT-5 Nano78.7%13.3s$0.22
OpenAI: gpt-oss-20b73.3%6.4s$0.06
OpenAI: gpt-oss-120b48.3%11.2s$0.11
OpenAI: GPT-5.1-Codex-Max——$5.63
OpenAI: GPT-5.1——$5.63
OpenAI: GPT-5.1 Chat——$5.63
OpenAI: GPT-5.1-Codex——$5.63
OpenAI: GPT-5.1-Codex-Mini——$1.13
OpenAI: gpt-oss-safeguard-20b——$0.19
OpenAI: GPT-5 Image Mini——$2.25
OpenAI: GPT-5 Image——$10.00
OpenAI: o3 Deep Research——$25.00
OpenAI: o4 Mini Deep Research——$5.00
OpenAI: GPT-5 Pro——$67.50
OpenAI: GPT-5 Codex——$5.63
OpenAI: GPT-4o Audio——$6.25
OpenAI: GPT-5 Chat——$5.63
OpenAI: GPT-5——$5.63
OpenAI: gpt-oss-120b——$0.0000
OpenAI: gpt-oss-120b——$0.11
OpenAI: gpt-oss-20b——$0.0000
OpenAI: o3 Pro——$50.00
OpenAI: Codex Mini——$3.75
OpenAI: o4 Mini High——$2.75
OpenAI: o3——$5.00
OpenAI: o4 Mini——$2.75
OpenAI: GPT-4.1——$5.00
OpenAI: GPT-4.1 Mini——$1.00
OpenAI: GPT-4.1 Nano——$0.25
OpenAI: o1-pro——$375.00
OpenAI: GPT-4o-mini Search Preview——$0.38
OpenAI: GPT-4o Search Preview——$6.25
OpenAI: o3 Mini High——$2.75
OpenAI: o3 Mini——$2.75
OpenAI: o1——$37.50
OpenAI: GPT-4o (2024-11-20)——$6.25
OpenAI: ChatGPT-4o——$10.00
OpenAI: GPT-4o-mini (2024-07-18)——$0.38
OpenAI: GPT-4o-mini——$0.38
OpenAI: GPT-4o (2024-05-13)——$10.00
OpenAI: GPT-4o——$6.25
OpenAI: GPT-4o——$12.00
OpenAI: GPT-4 Turbo——$20.00
OpenAI: GPT-3.5 Turbo (older v0613)——$1.50
OpenAI: GPT-4 Turbo Preview——$20.00
OpenAI: GPT-4 Turbo (older v1106)——$20.00
OpenAI: GPT-3.5 Turbo Instruct——$1.75
OpenAI: GPT-3.5 Turbo 16k——$3.50
OpenAI: GPT-4 (older v0314)——$45.00
OpenAI: GPT-4——$45.00
OpenAI: GPT-3.5 Turbo——$1.00

Benchmark Performance

How this model performs across different benchmarks

No benchmark data available

Run benchmarks with this model to see performance breakdown

Price vs Performance

Compare cost efficiency across all models

Current model
Other models
X-axis uses log scale for better visualization of price range

Score Over Time

Performance trends across all benchmark runs

No score trend data

Score history will appear here after multiple runs

Benchmark Activity

Number of benchmark runs over time

No activity data

Activity will appear here after benchmark runs

Quickstart

Get started with this model using OpenRouter

View on OpenRouter
import { OpenRouter } from "@openrouter/sdk";

const openrouter = new OpenRouter({
  apiKey: "<OPENROUTER_API_KEY>"
});

const completion = await openrouter.chat.completions.create({
  model: "openai/gpt-4o-2024-08-06",
  messages: [
    {
      role: "user",
      content: "Hello!"
    }
  ]
});

console.log(completion.choices[0].message.content);

Get your API key at openrouter.ai/keys