modelbenchmark.io

anthropic-claude-3-5-haiku

anthropic-claude-3-5-haiku

Compare

Specification

most-agreed values

Context
200K
Max output
1K
Released
—
Knowledge cutoff
—
Retires
—
Open weights
—
Input
—
Output
—

Price

US dollars per million tokens · most-agreed

Input
$0.80
Output
$4.00

Quality

2 benchmarks · 2 sources

Composite
26th
percentile of 344 scored models
Rank
256 / 344
±0.09 sd
Evidence
2 × 2
one source, or fewer than 3 benchmarks
Effort range
—
one configuration only
coding23rd2/3 bench

Every score

one row per source and configuration — nothing averaged away

BenchmarkScoreConfigurationSourceRun
SWE-Bench verified40.6default · ToolsSWE-bench—
Aider polyglot28.0default · aider diffAider2024-12-21

The leading figure for a benchmark is the median across its configurations, so one heroic high-effort run cannot set the number.

Available from 1 host

HostIn $/MOut $/MCache rdCache wrContextOutputRetires
gradient_ai · gradient-ai$0.80$4.00——200K1K—

Other listings of this model

this page is one of them

The corpus files anthropic-claude-3-5-haiku under several keys. This page is the anthropic-claude-3-5-haiku listing. The full record — every host, every price and every benchmark score — is on the main anthropic-claude-3-5-haiku page.