Name: Llama 3.1 70B Instruct
Brand: Meta

Llama 3.1 70B Instruct is Meta's language model with a 131K context window and up to 16K output tokens, available from 12 providers, starting at $0.1 / 1M input and $0.1 / 1M output. Meta's 70B instruction-tuned LLM with strong tool-use and multilingual capabilities, widely deployed across cloud regions for enterprise workloads.

Specifications
Canonical ID	`meta-llama-3-1-70b-instruct`
Type	Language
Status	Deprecated
Creator	Meta
Providers	Amazon Bedrock Azure AI Foundry DeepInfra Fireworks AI Hyperbolic Lambda OpenRouter Oracle Cloud (OCI)Weights & Biases OVHcloud Perplexity Together AI
Context Window	131K tokens
Max Output	16K tokens
Input Modalities	ImageText
Output Modalities	Text
Parameters	70B
HuggingFace Likes	907
HuggingFace Downloads (30d)	737,459
HuggingFace Downloads (all-time)	20,735,812
Release Date	2024-07-23 · 2 years ago
Knowledge Cutoff	2023-12-31 · 3 years ago
Deprecation Date	2025-06-30

Benchmarks
Intelligence Index	#448
Math Index	#256
MMLU-Pro	#241
GPQA	#446
HLE	#433
LiveCodeBench	#257
AIME	#108
IFBench	#319
Time to First Token	#463
SciCode	#373
MATH-500	#151
AIME 2025	#256
LCR	#402
TerminalBench Hard	#313
TAU2	#364
Output TPS	#237

Capabilities

Input2/5

Text✓

Image✓

Audio·

Video·

PDF·

Output1/5

Text✓

Image·

Audio·

Video·

Embedding·

Capabilities4/13

Reasoning·

Adaptive Reasoning·

Function Calling✓

Parallel Function Calling✓

Structured Outputs✓

Native JSON Schema✓

Web Search·

URL Context·

Computer Use·

Code Execution·

File Search·

Prompt Caching·

Assistant Prefill·

Pricing by Provider

US Dollar ($)

Per 1M tokens

Provider	Standard		Batch
Provider	Input $ / 1M	Output $ / 1M	Input $ / 1M	Output $ / 1M
Amazon Bedrock `meta.llama3-1-70b-instruct-v1:0`	$0.72	$0.72	$0.36	$0.36
Azure AI Foundry `azure_ai/Meta-Llama-3.1-70B-Instruct`	$2.68	$3.54	—	—
DeepInfra `deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct`	$0.4	$0.4	—	—
Fireworks AI `fireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct`	$0.9	$0.9	—	—
Fireworks AI `fireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct-1b`	$0.1	$0.1	—	—
Hyperbolic `hyperbolic/meta-llama/Meta-Llama-3.1-70B-Instruct`	$0.12	$0.3	—	—
Lambda `lambda_ai/llama3.1-70b-instruct-fp8`	$0.12	$0.3	—	—
OpenRouter `meta-llama/llama-3.1-70b-instruct`	$0.4	$0.4	—	—
Oracle Cloud (OCI) `oci/meta.llama-3.1-70b-instruct`	$0.72	$0.72	—	—
OVHcloud `ovhcloud/Meta-Llama-3_1-70B-Instruct`	$0.67	$0.67	—	—
Perplexity `perplexity/llama-3.1-70b-instruct`	$1.00	$1.00	—	—
Together AI `together_ai/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo`	$0.88	$0.88	—	—
Weights & Biases `wandb/meta-llama/Llama-3.1-70B-Instruct`	$0.8	$0.8	—	—

Cost Calculator

US Dollar ($)

Preset:

Input tokens

Output tokens

Number of calls

Cheapest Instances to Run It

Cloud GPU instances that can host Llama 3.1 70B Instruct, ranked by cheapest on-demand price. The model needs about 168 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds

FP16 (full precision)

US Dollar ($)

Instance	Cloud	GPU	VRAM	Price
Standard_NP40s	Azure	4× AMD Alveo U250 FPGA (64GB)	256 GB	$6.60/hr
g2-standard-96	GCP	8× nvidia-l4	192 GB	$7.98/hr
g7e.12xlarge	AWS	2× RTX PRO Server 6000	192 GB	$8.29/hr
7 more instances can run Llama 3.1 70B Instruct Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Versions

Version	Released	Context	Input / 1M	Output / 1M	Status
Llama 3.3 70B Instruct	2024-12-06	131K	$0.120	$0.200	Deprecated
Llama 3.2 3B Instruct	2024-09-25	131K	$0.015	$0.020	Deprecated
Llama 3.2 1B Instruct	2024-09-25	131K	$0.020	$0.020	Deprecated
Llama 3.1 70B Instruct	2024-07-23	131K	$0.100	$0.100	Current
Llama 3.1 405B Instruct	2024-07-23	131K	$0.120	$0.300	Deprecated
Llama 3.1 8B Instruct	2024-07-23	200K	$0.020	$0.030	Deprecated
Llama 3.1 70B	2024-07-23	128K	$0.360	$0.360	Available
Llama 3.1 8B	2024-07-23	131K	$0.030	$0.050	Available
Llama 3 70B Instruct	2024-04-23	131K	$0.120	$0.300	Deprecated
Llama 3 8B Instruct	2024-04-23	32K	$0.030	$0.040	Deprecated
Llama 3.1 Tulu3 405B	—	—	—	—	Available

Model IDs

accounts/fireworks/models/llama-v3p1-70b-instruct

accounts/fireworks/models/llama-v3p1-70b-instruct-1b

azure_ai/Meta-Llama-3.1-70B-Instruct

deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct

deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo

fireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct

fireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct-1b

friendliai/meta-llama-3.1-70b-instruct

hyperbolic/meta-llama/Meta-Llama-3.1-70B-Instruct

lambda_ai/llama3.1-70b-instruct-fp8

llama-3-1-instruct-70b

meta-llama-3-1-70b-instruct

meta-llama/llama-3.1-70b-instruct

meta-llama/Meta-Llama-3.1-70B-Instruct

meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo

meta-textgeneration-llama-3-1-70b-instruct

meta-textgenerationneuron-llama-3-1-70b-instruct

meta.llama3-1-70b-instruct-v1:0

meta.llama3-1-70b-instruct-v1:0:128k

nebius/meta-llama/Meta-Llama-3.1-70B-Instruct

oci/meta.llama-3.1-70b-instruct

openrouter/meta-llama/llama-3.1-70b-instruct

ovhcloud/Meta-Llama-3_1-70B-Instruct

perplexity/llama-3.1-70b-instruct

together_ai/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo

us.meta.llama3-1-70b-instruct-v1:0

vertex_ai/meta/llama-3.1-70b-instruct-maas

wandb/meta-llama/Llama-3.1-70B-Instruct

Llama 3.1 70B Instruct

CapabilitiesAPIGET/api/v1/models/meta-llama-3-1-70b-instruct

Pricing by ProviderAPIGET/api/v1/models/meta-llama-3-1-70b-instruct/pricing

Cost CalculatorAPIGET/api/v1/models/meta-llama-3-1-70b-instruct/pricing/calculate?input_tokens=1000000&output_tokens=500000

Cheapest Instances to Run ItAPIGET/api/v1/models/meta-llama-3-1-70b-instruct/instances

VersionsAPIGET/api/v1/models?family=llama

Model IDsAPIGET/api/v1/models/meta-llama-3-1-70b-instruct

Capabilities

Pricing by Provider

Cost Calculator

Cheapest Instances to Run It

Versions

Model IDs