Llama 3.1 405B Instruct Long is Meta's language model with a 4K context window and up to 4K output tokens, starting at $0.1 / 1M input and $0.1 / 1M output. Extended-context variant of the Llama 3.1 405B instruction-tuned model, designed for processing very long documents and multi-turn conversations.
Specifications
Canonical IDmeta-llama-3-1-405b-instruct-long
TypeLanguage
StatusActive
CreatorMetaMeta
Providers
Context Window4K tokens
Max Output4K tokens
Input ModalitiesText
Output ModalitiesText
Parameters405B

Capabilities

Input1/5
Text
Image·
Audio·
Video·
PDF·
Output1/5
Text
Image·
Audio·
Video·
Embedding·
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Pricing by Provider

US Dollar ($)
Per 1M tokens
ProviderStandard
Input
$ / 1M
Output
$ / 1M
Fireworks AI logo
Fireworks AI
fireworks_ai/accounts/fireworks/models/llama-v3p1-405b-instruct-long
$0.1$0.1

Cost Calculator

US Dollar ($)
Preset:

Cheapest Instances to Run It

Cloud GPU instances that can host Llama 3.1 405B Instruct Long, ranked by cheapest on-demand price. The model needs about 972 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
Standard_ND96isr_MI300X_v5Azure8× AMD Instinct MI300X1536 GB$48.00/hrwestus3
p5en.48xlargeAWS8× H2001128 GB$63.30/hrus-east-1
Standard_ND96isr_H200_v5Azure8× NVIDIA H200 GPU (141GB)1128 GB$84.80/hrwestus2
3 more instances can run Llama 3.1 405B Instruct Long
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Llama 3.3 70B Instruct131K$0.120$0.200Deprecating
Llama 3.2 3B Instruct131K$0.015$0.020Deprecated
Llama 3.2 1B Instruct131K$0.027$0.080Deprecated
Llama 3.2 11B128K$0.160$0.160Available
Llama 3.1 405B Instruct131K$0.120$0.300Deprecated
Llama 3.1 8B Instruct200K$0.020$0.030Deprecated
Llama 3.1 70B Instruct131K$0.120$0.300Available
Llama 3.1 70B128K$0.360$0.360Available
Llama 3.1 8B131K$0.030$0.050Available
Llama 3 70B Instruct131K$0.120$0.300Deprecated
Llama 3.1 405B Instruct Long4K$0.100$0.100Current

Model IDs

accounts/fireworks/models/llama-v3p1-405b-instruct-long
fireworks_ai/accounts/fireworks/models/llama-v3p1-405b-instruct-long
meta-llama-3-1-405b-instruct-long