Llama 3.1 8B Instruct
DeprecatedLlama 3.1 8B Instruct is Meta's language model with a 200K context window and up to 128K output tokens, available from 16 providers, starting at $0.02 / 1M input and $0.03 / 1M output. Meta's 8B instruction-tuned LLM optimized for fast, cost-effective deployment across multiple cloud regions with strong instruction-following performance.
| Benchmarks | |
|---|---|
| Intelligence Index | #434 |
| Coding Index | #204 |
| Math Index | #254 |
| MMLU-Pro | #297 |
| GPQA | #518 |
| HLE | #367 |
| LiveCodeBench | #301 |
| AIME | #140 |
| IFBench | #373 |
| Time to First Token | #389 |
| SciCode | #473 |
| MATH-500 | #164 |
| AIME 2025 | #254 |
| LCR | #367 |
| TerminalBench Hard | #360 |
| TAU2 | #357 |
| Output TPS | #82 |
Capabilities
Input2/5
Text✓
Image✓
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities5/13
Reasoning·
Adaptive Reasoning·
Function Calling✓
Parallel Function Calling✓
Structured Outputs✓
Native JSON Schema✓
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching✓
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | Batch | ||||
|---|---|---|---|---|---|---|
| Input $ / 1M | Output $ / 1M | Cache Read $ / 1M | Cache Write 5m $ / 1M | Input $ / 1M | Output $ / 1M | |
| $0.22 | $0.22 | N/A | N/A | $0.11 | $0.11 | |
| $0.282 | $0.827 | N/A | N/A | — | — | |
| $0.15 | $0.45 | $0.15 | $0.15 | — | — | |
| $0.03 | $0.05 | N/A | N/A | — | — | |
| $0.02 | $0.04 | N/A | N/A | — | — | |
| $0.1 | $0.1 | N/A | N/A | — | — | |
| $0.02 | $0.05 | N/A | N/A | — | — | |
| $0.06 | $0.06 | N/A | N/A | — | — | |
| $0.12 | $0.3 | N/A | N/A | — | — | |
| $0.025 | $0.04 | N/A | N/A | — | — | |
| $0.02 | $0.05 | N/A | N/A | — | — | |
| $0.03 | $0.03 | N/A | N/A | — | — | |
| $0.05 | $0.08 | $0.025 | N/A | — | — | |
| $0.72 | $0.72 | N/A | N/A | — | — | |
| $0.1 | $0.1 | N/A | N/A | — | — | |
| $0.2 | $0.2 | N/A | N/A | — | — | |
| $0.18 | $0.18 | N/A | N/A | — | — | |
| $0.22 | $0.22 | N/A | N/A | — | — | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host Llama 3.1 8B Instruct, ranked by cheapest on-demand price. The model needs about 19 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| g2-standard-4 |  GCP | nvidia-l4 | 24 GB | $0.705/hr | ||
| g6.xlarge |  AWS | L4 | 22 GB | $0.805/hr | ||
| g2-standard-8 | GCP | nvidia-l4 | 24 GB | $0.851/hr | ||
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Llama 3.3 70B Instruct | 131K | $0.120 | $0.200 | Deprecated | |
| Llama 3.2 3B Instruct | 131K | $0.015 | $0.020 | Deprecated | |
| Llama 3.2 1B Instruct | 131K | $0.020 | $0.020 | Deprecated | |
| Llama 3.1 8B Instruct | 200K | $0.020 | $0.030 | Current | |
| Llama 3.1 405B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 3.1 70B Instruct | 131K | $0.100 | $0.100 | Deprecated | |
| Llama 3.1 70B | 128K | $0.360 | $0.360 | Available | |
| Llama 3.1 8B | 131K | $0.030 | $0.050 | Available | |
| Llama 3 70B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 3 8B Instruct | 32K | $0.030 | $0.040 | Deprecated | |
| Llama 3.1 Tulu3 405B | — | — | — | — | Available |