Nemotron 120B A12B
Nemotron 120B A12B is NVIDIA's language model, starting at $0.3 / 1M input and $0.75 / 1M output. A 120B-parameter hybrid Mixture-of-Experts LLM from NVIDIA with 12B active parameters, designed for compute-efficient reasoning and agentic workloads.
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | |
|---|---|---|
| Input $ / 1M | Output $ / 1M | |
| $0.3 | $0.75 | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host Nemotron 120B A12B, ranked by cheapest on-demand price. The model needs about 288 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| a3-megagpu-8g |  GCP | 8× nvidia-h100-mega-80gb | 640 GB | $10.42/hr | ||
| a3-ultragpu-8g | GCP | 8× nvidia-h200-141gb | 1128 GB | $13.82/hr | ||
| Standard_NC96ads_A100_v4 |  Azure | 4× NVIDIA A100 | 320 GB | $14.69/hr | ||
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Nemotron 4 15B | — | — | — | — | Available |
| Nemotron Lightning 3.5 | 1.0M | $0.050 | $0.200 | Available | |
| Nemotron 3.5 Lightning 30B | 1.0M | — | — | Available | |
| Nemotron 3 Ultra 550B A55B | 1.0M | $0.250 | $2.15 | Deprecated | |
| Nemotron 3.5 Content Safety | 131K | $0.200 | $0.200 | Available | |
| Nemotron Nano 3 30B A3B Omni Reasoning | 256K | — | — | Available | |
| Nemotron Super 3 120B | 256K | $0.150 | $0.650 | Available | |
| Nemotron Nano 3 30B | 262K | $0.060 | $0.240 | Available | |
| Nemotron Nano 3 30B A3B Reasoning | — | — | — | — | Available |
| Nemotron Nano 3 30B A3B Omni | — | — | — | — | Available |
| Nemotron 120B A12B | — | — | $0.300 | $0.750 | Current |