Meta logo

Llama 3.2 90B Instruct

Deprecated
Pricing & Specs API
Free REST API for prices, specs and benchmarks
Llama 3.2 90B Instruct is Meta's language model with a 128K context window and up to 4K output tokens, starting at $0.72 / 1M input and $0.72 / 1M output. Meta's 90B instruction-tuned multimodal LLM from Llama 3.2, deployed across cloud regions for large-scale vision and language workloads.
Specifications
Canonical IDmeta-llama-3-2-90b-instruct
TypeLanguage
StatusDeprecated
CreatorMetaMeta
Providers
Context Window128K tokens
Max Output4K tokens
Input ModalitiesImageText
Output ModalitiesText
Parameters90B
Release Date · 2 years ago
Deprecation Date

Capabilities

Input2/5
Text✓
Image✓
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities1/13
Reasoning·
Adaptive Reasoning·
Function Calling✓
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Pricing by Provider

US Dollar ($)
Per 1M tokens
ProviderStandard
Input
$ / 1M
Output
$ / 1M
Amazon Bedrock logo
Amazon Bedrock
meta.llama3-2-90b-instruct-v1:0
$0.72$0.72

Cost Calculator

US Dollar ($)
Preset:

Cheapest Instances to Run It

Cloud GPU instances that can host Llama 3.2 90B Instruct, ranked by cheapest on-demand price. The model needs about 216 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
Standard_NP40sAzure4× AMD Alveo U250 FPGA (64GB)256 GB$6.60/hr
Standard_NC96ads_A100_v4Azure4× NVIDIA A100320 GB$14.69/hr
g7e.24xlargeAWS4× RTX PRO Server 6000384 GB$16.57/hr
7 more instances can run Llama 3.2 90B Instruct
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Llama 3.3 70B Instruct131K$0.120$0.200Deprecated
Llama 3.2 90B Instruct128K$0.720$0.720Current
Llama 3.2 3B Instruct131K$0.015$0.020Deprecated
Llama 3.2 1B Instruct131K$0.020$0.020Deprecated
Llama 3.1 405B Instruct131K$0.120$0.300Deprecated
Llama 3.1 8B Instruct200K$0.020$0.030Deprecated
Llama 3.1 70B Instruct131K$0.100$0.100Deprecated
Llama 3.1 70B128K$0.360$0.360Available
Llama 3.1 8B131K$0.030$0.050Available
Llama 3 70B Instruct131K$0.120$0.300Deprecated
Llama 3 8B Instruct32K$0.030$0.040Deprecated

Model IDs

llama-3-2-instruct-90b-vision
meta-llama-3-2-90b-instruct
meta.llama3-2-90b-instruct-v1:0
meta.llama3-2-90b-instruct-v1:0:128k
us.meta.llama3-2-90b-instruct-v1:0