Llama 3.1 405B Instruct Long is Meta's language model with a 4K context window and up to 4K output tokens, starting at $0.1 / 1M input and $0.1 / 1M output. Extended-context variant of the Llama 3.1 405B instruction-tuned model, designed for processing very long documents and multi-turn conversations.
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | |
|---|---|---|
| Input $ / 1M | Output $ / 1M | |
| $0.1 | $0.1 | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host Llama 3.1 405B Instruct Long, ranked by cheapest on-demand price. The model needs about 972 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| Standard_ND96isr_MI300X_v5 | 8× AMD Instinct MI300X | 1536 GB | $48.00/hr | westus3 | ||
| p5en.48xlarge | 8× H200 | 1128 GB | $63.30/hr | us-east-1 | ||
| Standard_ND96isr_H200_v5 | 8× NVIDIA H200 GPU (141GB) | 1128 GB | $84.80/hr | westus2 | ||
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Llama 3.3 70B Instruct | 131K | $0.120 | $0.200 | Deprecating | |
| Llama 3.2 3B Instruct | 131K | $0.015 | $0.020 | Deprecated | |
| Llama 3.2 1B Instruct | 131K | $0.027 | $0.080 | Deprecated | |
| Llama 3.2 11B | 128K | $0.160 | $0.160 | Available | |
| Llama 3.1 405B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 3.1 8B Instruct | 200K | $0.020 | $0.030 | Deprecated | |
| Llama 3.1 70B Instruct | 131K | $0.120 | $0.300 | Available | |
| Llama 3.1 70B | 128K | $0.360 | $0.360 | Available | |
| Llama 3.1 8B | 131K | $0.030 | $0.050 | Available | |
| Llama 3 70B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 3.1 405B Instruct Long | — | 4K | $0.100 | $0.100 | Current |