Meta logo

Llama 3.1 70B Instruct

Pricing & Specs API
Free REST API for prices, specs and benchmarks
Llama 3.1 70B Instruct is Meta's language model with a 131K context window and up to 16K output tokens, available from 13 providers, starting at $0.12 / 1M input and $0.3 / 1M output. Meta's 70B instruction-tuned LLM with strong tool-use and multilingual capabilities, widely deployed across cloud regions for enterprise workloads.
Specifications
Canonical IDmeta-llama-3-1-70b-instruct
TypeLanguage
StatusActive
CreatorMetaMeta
Providers
Context Window131K tokens
Max Output16K tokens
Input ModalitiesImageText
Output ModalitiesText
Parameters70B
HuggingFace Likes907
HuggingFace Downloads (30d)737,459
HuggingFace Downloads (all-time)20,735,812
Release Date · 2 years ago
Knowledge Cutoff · 3 years ago
Benchmarks
Intelligence Index
6.8
#373
Math Index
4.0
#243
MMLU-Pro
0.7
#221
GPQA
0.4
#382
HLE
0.0
#346
LiveCodeBench
0.2
#243
AIME
0.2
#96
IFBench
0.3
#293
Time to First Token
0.69s
#312
SciCode
0.3
#295
MATH-500
0.6
#138
AIME 2025
0.0
#243
LCR
0.1
#332
TerminalBench Hard
0.0
#292
TAU2
0.2
#341
Output TPS
35.6
#243

Capabilities

Input2/5
Text✓
Image✓
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities4/13
Reasoning·
Adaptive Reasoning·
Function Calling✓
Parallel Function Calling✓
Structured Outputs✓
Native JSON Schema✓
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Pricing by Provider

US Dollar ($)
Per 1M tokens
ProviderStandardBatch
Input
$ / 1M
Output
$ / 1M
Input
$ / 1M
Output
$ / 1M
Amazon Bedrock logo
Amazon Bedrock
meta.llama3-1-70b-instruct-v1:0
$0.72$0.72$0.36$0.36
Azure AI Foundry logo
Azure AI Foundry
azure_ai/Meta-Llama-3.1-70B-Instruct
$2.68$3.54——
DeepInfra logo
DeepInfra
deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct
$0.4$0.4——
Fireworks AI logo
Fireworks AI
fireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct
$0.9$0.9——
FriendliAI logo
FriendliAI
friendliai/meta-llama-3.1-70b-instruct
$0.6$0.6——
Hyperbolic logo
Hyperbolic
hyperbolic/meta-llama/Meta-Llama-3.1-70B-Instruct
$0.12$0.3——
Lambda logo
Lambda
lambda_ai/llama3.1-70b-instruct-fp8
$0.12$0.3——
Nebius logo
Nebius
nebius/meta-llama/Meta-Llama-3.1-70B-Instruct
$0.13$0.4——
OpenRouter logo
OpenRouter
meta-llama/llama-3.1-70b-instruct
$0.4$0.4——
Oracle Cloud (OCI) logo
Oracle Cloud (OCI)
oci/meta.llama-3.1-70b-instruct
$0.72$0.72——
OVHcloud logo
OVHcloud
ovhcloud/Meta-Llama-3_1-70B-Instruct
$0.67$0.67——
Perplexity logo
Perplexity
perplexity/llama-3.1-70b-instruct
$1.00$1.00——
Together AI logo
Together AI
together_ai/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo
$0.88$0.88——

Cost Calculator

US Dollar ($)
Preset:

Cheapest Instances to Run It

Cloud GPU instances that can host Llama 3.1 70B Instruct, ranked by cheapest on-demand price. The model needs about 168 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
Standard_NP40sAzure4× AMD Alveo U250 FPGA (64GB)256 GB$6.60/hrwestus2
g2-standard-96GCP8× nvidia-l4192 GB$7.98/hrus-east4
g7e.12xlargeAWS2× RTX PRO Server 6000192 GB$8.29/hrus-east-1
7 more instances can run Llama 3.1 70B Instruct
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Llama 3.3 70B Instruct131K$0.120$0.200Deprecating
Llama 3.2 3B Instruct131K$0.015$0.020Deprecated
Llama 3.2 1B Instruct131K$0.027$0.080Deprecated
Llama 3.2 11B128K$0.160$0.160Available
Llama 3.1 70B Instruct131K$0.120$0.300Current
Llama 3.1 405B Instruct131K$0.120$0.300Deprecated
Llama 3.1 8B Instruct200K$0.020$0.030Deprecated
Llama 3.1 70B128K$0.360$0.360Available
Llama 3.1 8B131K$0.030$0.050Available
Llama 3 70B Instruct131K$0.120$0.300Deprecated
Llama 3 8B Instruct32K$0.030$0.040Available

Model IDs

accounts/fireworks/models/llama-v3p1-70b-instruct
accounts/fireworks/models/llama-v3p1-70b-instruct-1b
azure_ai/Meta-Llama-3.1-70B-Instruct
deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct
deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo
fireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct
fireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct-1b
friendliai/meta-llama-3.1-70b-instruct
hyperbolic/meta-llama/Meta-Llama-3.1-70B-Instruct
lambda_ai/llama3.1-70b-instruct-fp8
llama-3-1-instruct-70b
meta-llama-3-1-70b-instruct
meta-llama/llama-3.1-70b-instruct
meta-llama/Meta-Llama-3.1-70B-Instruct
meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo
meta-textgeneration-llama-3-1-70b-instruct
meta-textgenerationneuron-llama-3-1-70b-instruct
meta.llama3-1-70b-instruct-v1:0
meta.llama3-1-70b-instruct-v1:0:128k
nebius/meta-llama/Meta-Llama-3.1-70B-Instruct
oci/meta.llama-3.1-70b-instruct
ovhcloud/Meta-Llama-3_1-70B-Instruct
perplexity/llama-3.1-70b-instruct
together_ai/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo
us.meta.llama3-1-70b-instruct-v1:0
vertex_ai/meta/llama-3.1-70b-instruct-maas