Llama 3.1 Tulu3 405B is Allen AI's language model. A 405B instruction-tuned LLM from the Allen Institute for AI built on Llama 3.1, applying the Tulu 3 post-training recipe for strong alignment and instruction-following.
Specifications
Canonical IDallenai-tulu-3-405b
TypeLanguage
StatusActive
CreatorAllen AIAllen AI
Input ModalitiesText
Output ModalitiesText
Parameters405B
Benchmarks
Intelligence Index
#406
MMLU-Pro
#213
GPQA
#390
HLE
#514
LiveCodeBench
#228
AIME
#117
Time to First Token
#53
SciCode
#306
MATH-500
#114
Output TPS
#289

Capabilities

Input1/5
Text
Image·
Audio·
Video·
PDF·
Output1/5
Text
Image·
Audio·
Video·
Embedding·
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Cheapest Instances to Run It

Cloud GPU instances that can host Llama 3.1 Tulu3 405B, ranked by cheapest on-demand price. The model needs about 972 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
Standard_ND96is_MI300X_v5Azure8× AMD Instinct MI300X GPU (192GB)1536 GB$48.00/hr
Standard_ND96isr_MI300X_v5Azure8× AMD Instinct MI300X1536 GB$48.00/hr
p5en.48xlargeAWS8× H2001128 GB$63.30/hr
3 more instances can run Llama 3.1 Tulu3 405B
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Llama 3.3 70B Instruct131K$0.100$0.200Deprecated
Llama 3.2 3B Instruct131K$0.015$0.020Deprecated
Llama 3.2 1B Instruct131K$0.020$0.020Deprecated
Llama 3.1 405B Instruct131K$0.120$0.300Deprecated
Llama 3.1 8B Instruct200K$0.020$0.030Deprecated
Llama 3.1 70B Instruct131K$0.100$0.100Deprecated
Llama 3.1 70B128K$0.360$0.360Available
Llama 3.1 8B131K$0.030$0.050Available
Llama 3 70B Instruct131K$0.120$0.300Deprecated
Llama 3 8B Instruct32K$0.030$0.040Deprecated
Llama 3.1 Tulu3 405BCurrent

Model IDs

allenai-tulu-3-405b
tulu3-405b