Nemotron 3.5 30B A3B Lightning is NVIDIA's language model with a 262K context window, starting at $0.1 / 1M input and $0.25 / 1M output. A mixture-of-experts large language model in the Nemotron series optimized for fast, low-latency inference at scale.
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities1/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching✓
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | ||
|---|---|---|---|
| Input $ / 1M | Output $ / 1M | Cache Read $ / 1M | |
| $0.1 | $0.25 | $0.05 | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host Nemotron 3.5 30B A3B Lightning, ranked by cheapest on-demand price. The model needs about 72 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| Standard_NP20s | 2× AMD Alveo U250 FPGA (64GB) | 128 GB | $3.30/hr | |||
| g7e.2xlarge | RTX PRO Server 6000 | 96 GB | $3.36/hr | |||
| Standard_NC24ads_A100_v4 | NVIDIA A100 | 80 GB | $3.67/hr | |||
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Nemotron 4 15B | — | — | — | — | Available |
| Nemotron Lightning 3.5 | 1.0M | $0.050 | $0.200 | Available | |
| Nemotron 3.5 Lightning 30B | 1.0M | — | — | Available | |
| Nemotron 3 Ultra 550B A55B | 1.0M | $0.500 | $2.20 | Deprecated | |
| Nemotron 3.5 Content Safety | 131K | $0.200 | $0.200 | Available | |
| Nemotron Nano 3 30B A3B Omni Reasoning | 256K | — | — | Available | |
| Nemotron Super 3 120B | 256K | $0.150 | $0.650 | Available | |
| Nemotron Nano 3 30B | 262K | $0.060 | $0.240 | Available | |
| Nemotron 3.5 30B A3B Lightning | — | 262K | $0.100 | $0.250 | Current |
| Nemotron Nano 3 30B A3B Omni | — | — | — | — | Available |
| Nemotron Nano 3 30B A3B Reasoning | — | — | — | — | Available |