Name: Llama 3.1 70B Instruct
Brand: Meta

Llama 3.1 70B Instruct is

Meta's language model with a 131K context window and up to 8K output tokens, available from 12 providers, starting at $0.120 / 1M input and $0.300 / 1M output. A 70B instruction-tuned Llama 3.1 model with 128K context and strong tool-use support, optimized for high-quality dialogue and agentic applications.

Spec
Canonical ID	`meta-llama-3-1-70b-instruct`
Type	Language
Status	Active
Creator	Meta
Providers	Amazon Bedrock Microsoft Azure AI Foundry Deep Infra Fireworks AI FriendliAI Hyperbolic Lambda Labs Nebius OpenRouter Oracle Cloud Infrastructure (OCI)OVHcloud Perplexity
Context Window	131K tokens
Max Output	8K tokens
Input Modalities	ImageText
Output Modalities	Text
Parameters	70B
Release Date	2024-07-23 · 2 years ago

Intelligence Index	12.5 #229
Coding Index	10.9 #183
Math Index	4.0 #185
MMLU-Pro	0.7 #164
GPQA	0.4 #245
HLE	0.0 #212
LiveCodeBench	0.2 #187
AIME	0.2 #76
IFBench	0.3 #174
Time to First Token	0.68s #213
SciCode	0.3 #174
MATH-500	0.6 #113
AIME 2025	0.0 #185
LCR	0.1 #203
TerminalBench Hard	0.0 #175
TAU2	0.2 #213
Output TPS	28.7 #192

Capabilities

Input2/5

Text✓

Image✓

Audio·

Video·

PDF·

Output1/5

Text✓

Image·

Audio·

Video·

Embedding·

Capabilities3/13

Reasoning·

Adaptive Reasoning·

Function Calling✓

Parallel Function Calling✓

Structured Outputs✓

Native JSON Schema·

Web Search·

URL Context·

Computer Use·

Code Execution·

File Search·

Prompt Caching·

Assistant Prefill·

Pricing by Provider

Provider	Standard		Batch
Provider	Input $ / 1M	Output $ / 1M	Input $ / 1M	Output $ / 1M
Hyperbolic meta-llama/Meta-Llama-3.1-70B-Instruct	$0.120	$0.300	—	—
Lambda llama3.1-70b-instruct-fp8	$0.120	$0.300	—	—
Nebius meta-llama/Meta-Llama-3.1-70B-Instruct	$0.130	$0.400	—	—
DeepInfra meta-llama/Meta-Llama-3.1-70B-Instruct	$0.400	$0.400	—	—
OpenRouter meta-llama/llama-3.1-70b-instruct	$0.400	$0.400	—	—
FriendliAI meta-llama-3.1-70b-instruct	$0.600	$0.600	—	—
OVHcloud Meta-Llama-3_1-70B-Instruct	$0.670	$0.670	—	—
Amazon Bedrock meta.llama3-1-70b-instruct-v1:0	$0.720	$0.720	$0.360	$0.360
Oracle Cloud (OCI) meta.llama-3.1-70b-instruct	$0.720	$0.720	—	—
Fireworks AI accounts/fireworks/models/llama-v3p1-70b-instruct	$0.900	$0.900	—	—
Perplexity llama-3.1-70b-instruct	$1.00	$1.00	—	—
Azure AI Foundry Meta-Llama-3.1-70B-Instruct	$2.68	$3.54	—	—

Regional pricing

Provider-specific pricing that varies by region.

Amazon Bedrock

5 regions

Region	Standard		Batch
Region	Input $ / 1M	Output $ / 1M	Input $ / 1M	Output $ / 1M
Global
Global	$0.720	$0.720	$0.360	$0.360
Cross-region
US (cross-region)/ us	$0.720	$0.720	$0.360	$0.360
US
US East (Ohio)/ us-east-2	$0.720	$0.720	$0.360	$0.360
US East (Virginia)/ us-east-1	$0.720	$0.720	$0.360	$0.360
US West (Oregon)/ us-west-2	$0.720	$0.720	$0.360	$0.360

Cost Calculator

Preset:

Input tokens

Output tokens

Number of calls

Compares every provider & tier in USD

Versions

Version	Released	Context	Input / 1M	Output / 1M	Status
Llama 3.3 70B Instruct	2024-12-06	131K	$0.720	$0.720	Available
Llama 3.3 70B Instruct	2024-12-06	131K	$0.100	$0.300	Available
Llama 3.3	—	—	—	—	Available
Llama 3.3 70B Instruct Turbo	—	131K	$0.130	$0.390	Available
Llama 3.3 70B Versatile	—	128K	$0.590	$0.790	Available
Llama 3.3 8B Instruct	—	128K	—	—	Available
Llama 3.2 11B Vision Instruct	2024-09-25	128K	$0.160	$0.160	Available
Llama 3.2 1B Instruct	2024-09-25	128K	$0.027	$0.080	Deprecated
Llama 3.2 3B Instruct	2024-09-25	131K	$0.015	$0.020	Deprecated
Llama 3.2 90B Vision Instruct	2024-09-25	128K	$0.720	$0.720	Available
Llama 3.1 70B Instruct	2024-07-23	131K	$0.120	$0.300	Current

HuggingFace

907 likes813,797 downloads/month20,668,910 total downloads

Llama 3.1 70B Instruct