Open Llama instruction model for multilingual chat, reasoning, and coding
Specification
most-agreed values
Context
128K
Max output
8K
Released
2024-07-23
Knowledge cutoff
2023-12
Retires
—
Open weights
no
Input
text
Output
text
Price
US dollars per million tokens · most-agreed
Input
$0.72
Output
$0.72
Quality
3 benchmarks · 1 source
Composite
20th
percentile of 334 scored models
Rank
267 / 334
±0.06 sd
Evidence
3 × 1
one source, or fewer than 3 benchmarks
Effort range
—
one configuration only
reasoning25th1/4 bench
math17th2/7 bench
Every score
one row per source and configuration — nothing averaged away
| Benchmark | Score | Configuration | Source | Run |
|---|---|---|---|---|
| MATH level 5 | 36.7 ±1.0 | default | Epoch AI | 2025-01-27 |
| GPQA diamond | 44.2 ±2.5 | default | Epoch AI | 2025-01-27 |
| OTIS Mock AIME 2024-2025 | 3.6 ±1.7 | default | Epoch AI | 2025-02-25 |
The leading figure for a benchmark is the median across its configurations, so one heroic high-effort run cannot set the number.
Available from 2 hosts
| Host | In $/M | Out $/M | Cache rd | Cache wr | Context | Output | Retires |
|---|---|---|---|---|---|---|---|
| vercel | $0.72 | $0.72 | — | — | 128K | 8K | — |
| vercel_ai_gateway · vercel-ai-gateway | $0.72 | $0.72 | — | — | 128K | 8K | — |
More from Meta
most-hosted first