modelbenchmark.io

claude-3-sonnet

Anthropic · claude-3-sonnet

Compare

Specification

most-agreed values

Context
200K
Max output
4K
Released
—
Knowledge cutoff
—
Retires
—
Open weights
—
Input
—
Output
—

Price

US dollars per million tokens · most-agreed

Input
$3.00
Output
$15.00

Quality

3 benchmarks · 1 source

Composite
13th
percentile of 344 scored models
Rank
299 / 344
±0.06 sd
Evidence
3 × 1
one source, or fewer than 3 benchmarks
Effort range
—
one configuration only
reasoning17th1/4 bench
math9th2/7 bench

Every score

one row per source and configuration — nothing averaged away

BenchmarkScoreConfigurationSourceRun
GPQA diamond40.6 ±2.4defaultEpoch AI2025-01-27
MATH level 518.2 ±0.8defaultEpoch AI2025-01-27
OTIS Mock AIME 2024-20252.5 ±1.9defaultEpoch AI2025-02-25

The leading figure for a benchmark is the median across its configurations, so one heroic high-effort run cannot set the number.

Available from 1 host

HostIn $/MOut $/MCache rdCache wrContextOutputRetires
vertex_ai-anthropic_models$3.00$15.00——200K4K—

More from Anthropic

most-hosted first