Name: Llama 3.1 8B Instruct
Brand: Meta

Llama 3.1 8B Instruct is Meta's language model with a 200K context window and up to 128K output tokens, available from 21 providers, starting at $0.02 / 1M input and $0.03 / 1M output. Meta's 8B instruction-tuned LLM optimized for fast, cost-effective deployment across multiple cloud regions with strong instruction-following performance.

Specifications
Canonical ID	`meta-llama-3-1-8b-instruct`
Type	Language
Status	Active
Creator	Meta
Providers	Amazon Bedrock Azure AI Foundry Cloudflare Workers AI Databricks DeepInfra Fireworks AI FriendliAI Groq Hugging Face Hyperbolic Lambda Nebius Novita Nscale OpenRouter Oracle Cloud (OCI)Weights & Biases OVHcloud Perplexity SambaNova Together AI
Context Window	200K tokens
Max Output	128K tokens
Input Modalities	ImageText
Output Modalities	Text
Parameters	8B
HuggingFace Likes	5,731
HuggingFace Downloads (30d)	9,306,502
HuggingFace Downloads (all-time)	140,394,735
Release Date	2024-07-23 · 2 years ago
Knowledge Cutoff	2023-12-31 · 2 years ago

Benchmarks
Intelligence Index	6.1 #375
Math Index	4.3 #241
MMLU-Pro	0.5 #280
GPQA	0.3 #444
HLE	0.1 #282
LiveCodeBench	0.1 #287
AIME	0.1 #130
IFBench	0.3 #347
Time to First Token	0.49s #254
SciCode	0.1 #386
MATH-500	0.5 #153
AIME 2025	0.0 #241
LCR	0.2 #275
TerminalBench Hard	0.0 #337
TAU2	0.2 #331
Output TPS	201.7 #37

Capabilities

Input2/5

Text✓

Image✓

Audio·

Video·

PDF·

Output1/5

Text✓

Image·

Audio·

Video·

Embedding·

Capabilities4/13

Reasoning·

Adaptive Reasoning·

Function Calling✓

Parallel Function Calling✓

Structured Outputs✓

Native JSON Schema✓

Web Search·

URL Context·

Computer Use·

Code Execution·

File Search·

Prompt Caching·

Assistant Prefill·

Pricing by Provider

US Dollar ($)

Per 1M tokens

Provider	Standard		Batch
Provider	Input $ / 1M	Output $ / 1M	Input $ / 1M	Output $ / 1M
Amazon Bedrock `meta.llama3-1-8b-instruct-v1:0`	$0.22	$0.22	$0.11	$0.11
Azure AI Foundry `azure_ai/Meta-Llama-3.1-8B-Instruct`	$0.3	$0.61	—	—
Cloudflare Workers AI `@cf/meta/llama-3.1-8b-instruct`	$0.282	$0.827	—	—
Databricks `databricks/databricks-meta-llama-3-1-8b-instruct`	$0.15	$0.45	—	—
DeepInfra `deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct`	$0.03	$0.05	—	—
Fireworks AI `fireworks_ai/accounts/fireworks/models/llama-v3p1-8b-instruct`	$0.1	$0.1	—	—
FriendliAI `friendliai/meta-llama-3.1-8b-instruct`	$0.1	$0.1	—	—
Groq `groq/llama-3.1-8b-instant`	$0.05	$0.08	—	—
Hugging Face `novita:meta-llama/llama-3.1-8b-instruct`	$0.02	$0.05	—	—
Hugging Face `nscale:meta-llama/Llama-3.1-8B-Instruct`	$0.06	$0.06	—	—
Hyperbolic `hyperbolic/meta-llama/Meta-Llama-3.1-8B-Instruct`	$0.12	$0.3	—	—
Lambda `lambda_ai/llama3.1-8b-instruct`	$0.025	$0.04	—	—
Nebius `nebius/meta-llama/Meta-Llama-3.1-8B-Instruct`	$0.02	$0.06	—	—
Novita `novita/meta-llama/llama-3.1-8b-instruct`	$0.02	$0.05	—	—
Nscale `nscale/meta-llama/Llama-3.1-8B-Instruct`	$0.03	$0.03	—	—
OpenRouter `meta-llama/llama-3.1-8b-instruct`	$0.02	$0.03	—	—
Oracle Cloud (OCI) `oci/meta.llama-3.1-8b-instruct`	$0.72	$0.72	—	—
OVHcloud `ovhcloud/Llama-3.1-8B-Instruct`	$0.1	$0.1	—	—
Perplexity `perplexity/llama-3.1-8b-instruct`	$0.2	$0.2	—	—
SambaNova `sambanova/Meta-Llama-3.1-8B-Instruct`	$0.1	$0.2	—	—
Together AI `together_ai/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo`	$0.18	$0.18	—	—
Weights & Biases `wandb/meta-llama/Llama-3.1-8B-Instruct`	$22.00	$22.00	—	—

Cost Calculator

US Dollar ($)

Preset:

Input tokens

Output tokens

Number of calls

Versions

Version	Released	Context	Input / 1M	Output / 1M	Status
Llama 3.3 70B Instruct	2024-12-06	131K	$0.100	$0.200	Available
Llama 3.2 3B Instruct	2024-09-25	131K	$0.015	$0.020	Deprecated
Llama 3.2 1B Instruct	2024-09-25	131K	$0.027	$0.080	Deprecated
Llama 3.2 11B	2024-09-25	128K	$0.160	$0.160	Available
Llama 3.1 8B Instruct	2024-07-23	200K	$0.020	$0.030	Current
Llama 3.1 405B Instruct	2024-07-23	131K	$0.120	$0.300	Deprecating
Llama 3.1 70B Instruct	2024-07-23	131K	$0.120	$0.300	Available
Llama 3.1 70B	2024-07-23	128K	$0.360	$0.360	Available
Llama 3.1 8B	2024-07-23	131K	$0.030	$0.050	Available
Llama 3 70B Instruct	2024-04-23	131K	$0.120	$0.300	Deprecated
Llama 3 8B Instruct	2024-04-18	32K	$0.030	$0.040	Available

Model IDs

@cf/meta/llama-3.1-8b-instruct

accounts/fireworks/models/full-llama-v3p1-8b-instruct-8b-fp8

accounts/fireworks/models/full-llama-v3p1-8b-instruct-8b-fp8-amd

accounts/fireworks/models/llama-v3p1-8b-instruct

azure_ai/Meta-Llama-3.1-8B-Instruct

databricks/databricks-meta-llama-3-1-8b-instruct

deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct

deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo

fireworks_ai/accounts/fireworks/models/llama-v3p1-8b-instruct

friendliai/meta-llama-3.1-8b-instruct

groq/llama-3.1-8b-instant

hyperbolic/meta-llama/Meta-Llama-3.1-8B-Instruct

lambda_ai/llama3.1-8b-instruct

llama-3-1-instruct-8b

meta-llama-3-1-8b-instruct

meta-llama/llama-3.1-8b-instruct

meta-llama/Meta-Llama-3.1-8B-Instruct

meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo

meta-textgeneration-llama-3-1-8b-instruct

meta-textgenerationneuron-llama-3-1-8b-instruct

meta.llama3-1-8b-instruct-v1:0

meta.llama3-1-8b-instruct-v1:0:128k

nebius/meta-llama/Meta-Llama-3.1-8B-Instruct

novita/meta-llama/llama-3.1-8b-instruct

nscale/meta-llama/Llama-3.1-8B-Instruct

oci/meta.llama-3.1-8b-instruct

ovhcloud/Llama-3.1-8B-Instruct

perplexity/llama-3.1-8b-instruct

sambanova/Meta-Llama-3.1-8B-Instruct

together_ai/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo

us.meta.llama3-1-8b-instruct-v1:0

vertex_ai/meta/llama-3.1-8b-instruct-maas

wandb/meta-llama/Llama-3.1-8B-Instruct

Llama 3.1 8B Instruct

CapabilitiesAPIGET/api/v1/models/meta-llama-3-1-8b-instruct

Pricing by ProviderAPIGET/api/v1/models/meta-llama-3-1-8b-instruct/pricing

Cost CalculatorAPIGET/api/v1/models/meta-llama-3-1-8b-instruct/pricing/calculate?input_tokens=1000000&output_tokens=500000

VersionsAPIGET/api/v1/models?family=llama

Model IDsAPIGET/api/v1/models/meta-llama-3-1-8b-instruct

Capabilities

Pricing by Provider

Cost Calculator

Versions

Model IDs