Nemotron Lightning 3.5 30B A3B
Nemotron Lightning 3.5 30B A3B is NVIDIA's language model. A 30B-parameter mixture-of-experts Nemotron Lightning model with 3B active parameters, built on the Nemotron-H architecture for efficient high-throughput inference.
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Cheapest Instances to Run It
Cloud GPU instances that can host Nemotron Lightning 3.5 30B A3B, ranked by cheapest on-demand price. The model needs about 72 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| Standard_NP20s |  Azure | 2× AMD Alveo U250 FPGA (64GB) | 128 GB | $3.30/hr | westus2 | |
| g7e.2xlarge |  AWS | RTX PRO Server 6000 | 96 GB | $3.36/hr | us-east-1 | |
| g2-standard-48 |  GCP | 4× nvidia-l4 | 96 GB | $3.99/hr | us-east4 | |
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Nemotron Super 3 120B A12B | 1.0M | $0.085 | $0.400 | Available | |
| Nemotron Nano 3 30B A3B | 262K | $0.050 | $0.200 | Available | |
| Nemotron Lightning 3.5 30B A3B | — | — | — | — | Current |
| Nemotron 3 Ultra | — | — | $0.600 | $2.40 | Available |
| Nemotron Nano 2 12B | 131K | $0.200 | $0.200 | Available | |
| Nemotron Nano 2 9B | 131K | $0.040 | $0.160 | Deprecated |