Llama 3.1 405B
Llama 3.1 405B is Meta's language model with a 128K context window and up to 16K output tokens, available from 3 providers, starting at $1.20 / 1M input and $1.20 / 1M output. Meta's flagship 405B-parameter pre-trained LLM in the Llama 3.1 series, offering frontier-scale text generation with FP8 precision support.
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities1/13
Reasoning·
Adaptive Reasoning·
Function Calling✓
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | |
|---|---|---|
| Input $ / 1M | Output $ / 1M | |
| $5.00 | $16.00 | |
| $5.00 | $16.00 | |
| $1.20 | $1.20 | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host Llama 3.1 405B, ranked by cheapest on-demand price. The model needs about 972 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| Standard_ND96isr_MI300X_v5 |  Azure | 8× AMD Instinct MI300X | 1536 GB | $48.00/hr | westus3 | |
| p5en.48xlarge |  AWS | 8× H200 | 1128 GB | $63.30/hr | us-east-1 | |
| Standard_ND96isr_H200_v5 | Azure | 8× NVIDIA H200 GPU (141GB) | 1128 GB | $84.80/hr | westus2 | |
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Llama 3.3 70B Instruct | 131K | $0.120 | $0.200 | Deprecated | |
| Llama 3.2 3B Instruct | 131K | $0.015 | $0.020 | Deprecated | |
| Llama 3.2 1B Instruct | 128K | $0.027 | $0.080 | Deprecated | |
| Llama 3.2 11B | 128K | $0.160 | $0.160 | Available | |
| Llama 3.1 405B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 3.1 8B Instruct | 200K | $0.020 | $0.030 | Deprecated | |
| Llama 3.1 70B Instruct | 131K | $0.120 | $0.300 | Available | |
| Llama 3.1 70B | 128K | $0.360 | $0.360 | Available | |
| Llama 3.1 8B | 131K | $0.030 | $0.050 | Available | |
| Llama 3 70B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 3.1 405B | — | 128K | $1.20 | $1.20 | Current |