Llama 2 70B Chat
Llama 2 70B Chat is Meta's language model with a 4K context window and up to 4K output tokens, available from 6 providers, starting at $0.5 / 1M input and $0.9 / 1M output. A 70B Llama 2 model fine-tuned with RLHF for dialogue, providing high-quality conversational responses at the largest Llama 2 scale.
| Benchmarks | |
|---|---|
| Intelligence Index | #498 |
| MMLU-Pro | #313 |
| GPQA | #472 |
| HLE | #345 |
| LiveCodeBench | #310 |
| AIME | #177 |
| Time to First Token | #188 |
| MATH-500 | #181 |
| Output TPS | #423 |
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | |||
|---|---|---|---|---|
| Input $ / 1M | Output $ / 1M | Cache Read $ / 1M | Cache Write 5m $ / 1M | |
| $1.95 | $2.56 | N/A | N/A | |
| $1.00 | $1.00 | N/A | N/A | |
| $0.5 | $1.50 | $0.5 | $0.5 | |
| $0.9 | $0.9 | N/A | N/A | |
| $0.7 | $2.80 | N/A | N/A | |
| $0.65 | $2.75 | N/A | N/A | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host Llama 2 70B Chat, ranked by cheapest on-demand price. The model needs about 168 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| Standard_NP40s |  Azure | 4× AMD Alveo U250 FPGA (64GB) | 256 GB | $6.60/hr | ||
| g2-standard-96 |  GCP | 8× nvidia-l4 | 192 GB | $7.98/hr | ||
| g7e.12xlarge |  AWS | 2× RTX PRO Server 6000 | 192 GB | $8.29/hr | ||
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Llama 3.3 70B Instruct | 131K | $0.120 | $0.200 | Deprecated | |
| Llama 3.2 3B Instruct | 131K | $0.015 | $0.020 | Deprecated | |
| Llama 3.2 1B Instruct | 131K | $0.020 | $0.020 | Deprecated | |
| Llama 3.2 11B | 128K | $0.160 | $0.160 | Available | |
| Llama 3.1 405B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 3.1 8B Instruct | 200K | $0.020 | $0.030 | Deprecated | |
| Llama 3.1 70B Instruct | 131K | $0.100 | $0.100 | Deprecated | |
| Llama 3.1 70B | 128K | $0.360 | $0.360 | Available | |
| Llama 3.1 8B | 131K | $0.030 | $0.050 | Available | |
| Llama 3 70B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 2 70B Chat | — | 4K | $0.500 | $0.900 | Current |