modelbenchmark.io

Anthropic: Claude 3.7 Sonnet

Anthropic · claude-3-7-sonnet

Compare

Balanced Claude model for coding, analysis, agent workflows, and cost control

Specification

most-agreed values

Context
200K
Max output
64K
Released
2025-02-19
Knowledge cutoff
2025-02
Retires
—
Open weights
no
Input
text, image
Output
text

Price

US dollars per million tokens · most-agreed

Input
$3.00
Output
$15.00
Cache read
$0.30
Cache write
$3.75

Quality

7 benchmarks · 3 sources

Composite
64th
percentile of 344 scored models
Rank
126 / 344
±0.05 sd
Evidence
7 × 3
3 or more benchmarks, from 2 or more sources
Effort range
12.5
points between effort settings
coding60th2/3 bench
reasoning78th1/4 bench
math49th4/7 bench

By reasoning effort

every setting placed on the same scale as the leaderboard

SettingCompositeBenchmarks behind it
32k69th5
16k62nd4
64k61st5

Every score

one row per source and configuration — nothing averaged away

BenchmarkScoreConfigurationSourceRun
MATH level 591.2 ±0.864kEpoch AI2025-03-13
↳90.0 ±0.832kEpoch AI2025-03-12
↳86.2 ±0.916kEpoch AI2025-02-26
↳68.2 ±1.1defaultEpoch AI2025-02-24
Settings differ by 23.0 points on this benchmark.
Aider polyglot64.932k · aider diffAider2025-02-24
GPQA diamond78.5 ±2.764kEpoch AI2025-05-26
↳76.8 ±3.016kEpoch AI2025-02-26
↳76.8 ±3.032kEpoch AI2025-03-10
↳66.0 ±2.7defaultEpoch AI2025-02-24
Settings differ by 12.5 points on this benchmark.
SWE-Bench verified61.0 ±2.2defaultEpoch AI2026-02-04
↳59.6default · Aime-coder v1 · 2 runsSWE-bench—
Sources and settings disagree by 1.4 points. Both figures stand.
OTIS Mock AIME 2024-202557.8 ±7.464kEpoch AI2025-03-13
↳53.3 ±7.532kEpoch AI2025-03-12
↳46.7 ±7.516kEpoch AI2025-02-26
↳21.9 ±4.8defaultEpoch AI2025-02-25
Settings differ by 35.9 points on this benchmark.
FrontierMath-Tier-4-2025-07-010.0 ±0.064kEpoch AI2025-07-01
FrontierMath-v12.1 ±1.216k · 2 runsEpoch AI2025-03-06
↳1.7 ±1.132k · 2 runsEpoch AI2025-03-13
↳1.6 ±0.0default · 2 runsEpoch AI2025-03-06
↳1.6 ±1.064k · 2 runsEpoch AI2025-03-13
Settings differ by 0.5 points on this benchmark.

The leading figure for a benchmark is the median across its configurations, so one heroic high-effort run cannot set the number.

Available from 12 hosts

HostIn $/MOut $/MCache rdCache wrContextOutputRetires
abacus$3.00$15.00——200K64K—
bedrock · eu$3.00$15.00$0.30$3.75200K8K—
bedrock_converse$3.00$15.00$0.30$3.75200K8K—
bedrock_converse · us$3.00$15.00$0.30$3.75200K8K—
helicone$3.00$15.00$0.30$3.75200K64K—
replicate · replicate$3.00$15.00—————
snowflake$3.00$15.00$0.30—200K16K—
vercel_ai_gateway · vercel-ai-gateway$3.00$15.00$0.30$3.75200K64K—
deepinfra$3.30$16.50$0.33—200K200K—
bedrock$3.60$18.00$0.36$4.50200K8K—
heroku · heroku————200K8K—
qiniu-ai————200K128K—

Other listings of this model

same model, different key

More from Anthropic

most-hosted first