Llama 3.1 405B Instruct is Meta's language model with a 131K context window and up to 16K output tokens, available from 11 providers, starting at $0.120 / 1M input and $0.300 / 1M output. Meta's 405B instruction-tuned LLM optimized for following complex instructions, with FP8 quantization for efficient large-scale inference.
Specifications
Canonical IDmeta-llama-3-1-405b-instruct
TypeLanguage
StatusDeprecating
CreatorMetaMeta
Providers
Context Window131K tokens
Max Output16K tokens
Input ModalitiesImageText
Output ModalitiesText
Parameters405B
Release Date · 2 years ago
Deprecation Date
Benchmarks
Intelligence Index
17.4
#249
Coding Index
14.5
#224
Math Index
3.0
#249
MMLU-Pro
0.7
#181
GPQA
0.5
#303
HLE
0.0
#365
LiveCodeBench
0.3
#204
AIME
0.2
#92
IFBench
0.4
#229
Time to First Token
0.64s
#279
SciCode
0.3
#219
MATH-500
0.7
#126
AIME 2025
0.0
#249
LCR
0.2
#221
TerminalBench Hard
0.1
#221
TAU2
0.2
#306
Output TPS
46.2
#225

Capabilities

Input2/5
Text
Image
Audio·
Video·
PDF·
Output1/5
Text
Image·
Audio·
Video·
Embedding·
Capabilities3/13
Reasoning·
Adaptive Reasoning·
Function Calling
Parallel Function Calling
Structured Outputs
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Pricing by Provider

ProviderStandardBatch
Input
$ / 1M
Output
$ / 1M
Input
$ / 1M
Output
$ / 1M
Hyperbolic logo
Hyperbolic
hyperbolic/meta-llama/Meta-Llama-3.1-405B-Instruct
$0.120$0.300
Lambda logo
Lambda
lambda_ai/llama3.1-405b-instruct-fp8
$0.800$0.800
Nebius logo
Nebius
nebius/meta-llama/Meta-Llama-3.1-405B-Instruct
$1.00$3.00
Fireworks AI logo
Fireworks AI
fireworks_ai/accounts/fireworks/models/llama-v3p1-405b-instruct
$3.00$3.00
Together AI logo
Together AI
together_ai/meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo
$3.50$3.50
Google Vertex AI logo
Google Vertex AI
vertex_ai/meta/llama-3.1-405b-instruct-maas
$5.00$16.00
SambaNova logo
SambaNova
sambanova/Meta-Llama-3.1-405B-Instruct
$5.00$10.00
Databricks logo
Databricks
databricks/databricks-meta-llama-3-1-405b-instruct
$5.00$15.00
Amazon Bedrock logo
Amazon Bedrock
meta.llama3-1-405b-instruct-v1:0
$5.32$16.00$1.20$1.20
Azure AI Foundry logo
Azure AI Foundry
azure_ai/Meta-Llama-3.1-405B-Instruct
$5.33$16.00
Oracle Cloud (OCI) logo
Oracle Cloud (OCI)
oci/meta.llama-3.1-405b-instruct
$10.68$10.68

Cost Calculator

Preset:

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Llama 3.3 70B Instruct131K$0.100$0.200Available
Llama 3.2 3B Instruct131K$0.015$0.020Deprecated
Llama 3.2 1B Instruct131K$0.027$0.080Deprecated
Llama 3.1 405B Instruct131K$0.120$0.300Current
Llama 3.1 70B Instruct131K$0.100$0.100Available
Llama 3.1 8B Instruct200K$0.020$0.030Available
Llama 3.1 70B128K$0.600$0.600Available
Llama 3.1 8B131K$0.030$0.050Available
Llama 3 70B Instruct131K$0.120$0.300Available
Llama 3 8B Instruct32K$0.030$0.040Available
Llama 3.1 Tulu3 405BAvailable

Model IDs