Nemotron 120B A12B is NVIDIA's language model, starting at $0.3 / 1M input and $0.75 / 1M output. A 120B-parameter hybrid Mixture-of-Experts LLM from NVIDIA with 12B active parameters, designed for compute-efficient reasoning and agentic workloads.
Specifications
Canonical IDnvidia-nemotron-120b-a12b
TypeLanguage
StatusActive
CreatorNVIDIANVIDIA
Providers
Input ModalitiesText
Output ModalitiesText
Parameters120B

Capabilities

Input1/5
Text
Image·
Audio·
Video·
PDF·
Output1/5
Text
Image·
Audio·
Video·
Embedding·
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Pricing by Provider

US Dollar ($)
Per 1M tokens
ProviderStandard
Input
$ / 1M
Output
$ / 1M
Baseten
baseten/nvidia/Nemotron-120B-A12B
$0.3$0.75

Cost Calculator

US Dollar ($)
Preset:

Cheapest Instances to Run It

Cloud GPU instances that can host Nemotron 120B A12B, ranked by cheapest on-demand price. The model needs about 288 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
Standard_NC96ads_A100_v4Azure4× NVIDIA A100320 GB$14.69/hrwestus2
g7e.24xlargeAWS4× RTX PRO Server 6000384 GB$16.57/hrus-east-1
p4d.24xlargeAWS8× A100320 GB$21.96/hrus-west-2
7 more instances can run Nemotron 120B A12B
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Nemotron 4 15BAvailable
Nemotron 3 Ultra 550B A55B1.0M$0.600$2.40Available
Nemotron 3.5 Content Safety128KAvailable
Nemotron Nano 3 30B A3B Omni Reasoning256KAvailable
Nemotron Super 3 120B256K$0.150$0.650Available
Nemotron Nano 3 30B262K$0.060$0.240Available
Nemotron Nano 3 30B A3B OmniAvailable
Nemotron Nano 3 30B A3B ReasoningAvailable
Nemotron Nano 3 4BAvailable
Nemotron 3Available
Nemotron 120B A12B$0.300$0.750Current

Model IDs

baseten/nvidia/Nemotron-120B-A12B
nvidia-nemotron-120b-a12b