Llama 3.1 405B Instruct
Llama 3.1 405B Instruct is Meta's language model with a 131K context window and up to 16K output tokens, available from 11 providers, starting at $0.120 / 1M input and $0.300 / 1M output. Meta's 405B instruction-tuned LLM optimized for following complex instructions, with FP8 quantization for efficient large-scale inference.
Meta's language model with a 131K context window and up to 16K output tokens, available from 11 providers, starting at $0.120 / 1M input and $0.300 / 1M output. Meta's 405B instruction-tuned LLM optimized for following complex instructions, with FP8 quantization for efficient large-scale inference.meta-llama-3-1-405b-instruct |
| Language |
| Deprecating |
| Meta |
| 131K tokens |
| 16K tokens |
| ImageText |
| Text |
| 405B |
| · 2 years ago |
17.4#247 |
14.5#222 |
3.0#249 |
0.7#181 |
0.5#301 |
0.0#362 |
0.3#204 |
0.2#92 |
0.4#229 |
0.69s#272 |
0.3#219 |
0.7#126 |
0.0#249 |
0.2#219 |
0.1#219 |
0.2#303 |
31.6#263 |
Capabilities
Input2/5
✓
✓
·
·
·
Output1/5
✓
·
·
·
·
Capabilities3/13
·
·
✓
✓
✓
·
·
·
·
·
·
·
·
Pricing by Provider
| Provider | Standard | Batch | ||
|---|---|---|---|---|
| Input $ / 1M | Output $ / 1M | Input $ / 1M | Output $ / 1M | |
 Hyperbolic | $0.120 | $0.300 | — | — |
 Lambda | $0.800 | $0.800 | — | — |
 Nebius | $1.00 | $3.00 | — | — |
 Fireworks AI | $3.00 | $3.00 | — | — |
 Together AI | $3.50 | $3.50 | — | — |
 Google Vertex AI | $5.00 | $16.00 | — | — |
 SambaNova | $5.00 | $10.00 | — | — |
 Databricks | $5.00 | $15.00 | — | — |
 Amazon Bedrock | $5.32 | $16.00 | $1.20 | $1.20 |
 Azure AI Foundry | $5.33 | $16.00 | — | — |
 Oracle Cloud (OCI) | $10.68 | $10.68 | — | — |
Regional pricing
Provider-specific pricing that varies by region.
Amazon Bedrock
4 regions
| Region | Standard | Batch | ||
|---|---|---|---|---|
| Input $ / 1M | Output $ / 1M | Input $ / 1M | Output $ / 1M | |
| Global | ||||
| Global | $5.32 | $16.00 | $1.20 | $1.20 |
| US | ||||
| US East (Ohio)/ us-east-2 | $2.40 | $2.40 | $1.20 | $1.20 |
| US East (Virginia)/ us-east-1 | — | — | $1.20 | $1.20 |
| US West (Oregon)/ us-west-2 | $2.40 | $2.40 | $1.20 | $1.20 |
Cost Calculator
Preset:
Compares every provider & tier in USD
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Llama 3.2 11B | 128K | $0.160 | $0.160 | Available | |
| Llama 3.2 11B Instruct | 128K | $0.350 | $0.350 | Deprecated | |
| Llama 3.2 1B Instruct | 128K | $0.027 | $0.080 | Deprecated | |
| Llama 3.2 3B Instruct | 131K | $0.015 | $0.020 | Deprecated | |
| Llama 3.2 90B | 128K | $0.720 | $0.720 | Available | |
| Llama 3.2 90B Instruct | 128K | $2.00 | $2.00 | Deprecated | |
| Llama 3.2 1B | 131K | $0.100 | $0.100 | Available | |
| Llama 3.2 3B | 131K | $0.040 | $0.080 | Available | |
| Llama 3.1 405B Instruct | 131K | $0.120 | $0.300 | Current | |
| Llama 3.1 70B | 128K | $0.600 | $0.600 | Available | |
| Llama 3.1 70B Instruct | 131K | $0.100 | $0.100 | Available |