Meta logo

Llama 3.1 8B

Pricing & Specs API
Free REST API for prices, specs and benchmarks
Llama 3.1 8B is Meta's language model with a 131K context window and up to 16K output tokens, available from 5 providers, starting at $0.03 / 1M input and $0.05 / 1M output. Meta's compact 8B pre-trained LLM in the Llama 3.1 series, offering efficient on-device or low-cost inference with tool-use support.
Specifications
Canonical IDmeta-llama-3-1-8b
TypeLanguage
StatusActive
CreatorMetaMeta
Providers
Context Window131K tokens
Max Output16K tokens
Input ModalitiesText
Output ModalitiesText
Parameters8B
Release Date · 2 years ago

Capabilities

Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities3/13
Reasoning·
Adaptive Reasoning·
Function Calling✓
Parallel Function Calling·
Structured Outputs✓
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching✓
Assistant Prefill·

Pricing by Provider

US Dollar ($)
Per 1M tokens
ProviderStandardBatch
Input
$ / 1M
Output
$ / 1M
Input
$ / 1M
Output
$ / 1M
Cerebras logo
Cerebras
cerebras/llama3.1-8b
$0.1$0.1——
LlamaGate
llamagate/llama-3.1-8b
$0.03$0.05——
Snowflake logo
Snowflake
llama3.1-8b
$0.11$0.11$0.055$0.055
Together AI logo
Together AI
together_ai/meta-llama/Meta-Llama-3.1-8B
$0.2$0.2——
Vercel AI Gateway logo
Vercel AI Gateway
meta/llama-3.1-8b
$0.22$0.22——

Cost Calculator

US Dollar ($)
Preset:

Cheapest Instances to Run It

Cloud GPU instances that can host Llama 3.1 8B, ranked by cheapest on-demand price. The model needs about 19 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
g2-standard-4GCPnvidia-l424 GB$0.705/hr
g6.xlargeAWSL422 GB$0.805/hr
g2-standard-8GCPnvidia-l424 GB$0.851/hr
7 more instances can run Llama 3.1 8B
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Llama 3.3 70B Instruct131K$0.120$0.200Deprecated
Llama 3.2 3B Instruct131K$0.015$0.020Deprecated
Llama 3.2 1B Instruct131K$0.020$0.020Deprecated
Llama 3.1 8B131K$0.030$0.050Current
Llama 3.1 405B Instruct131K$0.120$0.300Deprecated
Llama 3.1 8B Instruct200K$0.020$0.030Deprecated
Llama 3.1 70B Instruct131K$0.100$0.100Deprecated
Llama 3.1 70B128K$0.360$0.360Available
Llama 3 70B Instruct131K$0.120$0.300Deprecated
Llama 3 8B Instruct32K$0.030$0.040Deprecated
Llama 3.1 Tulu3 405B————Available

Model IDs

cerebras/llama3.1-8b
llamagate/llama-3.1-8b
meta-llama-3-1-8b
meta-textgeneration-llama-3-1-8b
meta-textgenerationneuron-llama-3-1-8b
meta/llama-3.1-8b
snowflake/llama3.1-8b
together_ai/meta-llama/Meta-Llama-3.1-8B
vercel_ai_gateway/meta/llama-3.1-8b