Nemotron Lightning 3.5
Nemotron Lightning 3.5 is NVIDIA's language model with a 1.0M context window and up to 236K output tokens, available from 4 providers, starting at $0.05 / 1M input and $0.2 / 1M output. NVIDIA's fast open model targeting always-on agents and high-volume specialized tasks with strong agentic capability.
| Benchmarks | |
|---|---|
| Intelligence Index | #178 |
| Coding Index | #119 |
| GPQA | #219 |
| HLE | #211 |
| Time to First Token | #379 |
| SciCode | #281 |
| LCR | #197 |
| Output TPS | #12 |
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities5/13
Reasoning✓
Adaptive Reasoning·
Function Calling✓
Parallel Function Calling·
Structured Outputs✓
Native JSON Schema✓
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching✓
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | Free | |||
|---|---|---|---|---|---|
| Input $ / 1M | Output $ / 1M | Cache Read $ / 1M | Input $ / 1M | Output $ / 1M | |
| $0.08 | $0.2 | $0.04 | — | — | |
| $0.06 | $0.24 | N/A | — | — | |
| $0.08 | $0.2 | $0.04 | N/A | N/A | |
| — | — | — | $N/A | $N/A | |
| $0.05 | $0.2 | $0.01 | — | — | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host Nemotron Lightning 3.5, ranked by cheapest on-demand price. The model needs about 76 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| Standard_NP20s |  Azure | 2× AMD Alveo U250 FPGA (64GB) | 128 GB | $3.30/hr | ||
| g7e.2xlarge |  AWS | RTX PRO Server 6000 | 96 GB | $3.36/hr | ||
| Standard_NC24ads_A100_v4 | Azure | NVIDIA A100 | 80 GB | $3.67/hr | ||
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Nemotron 4 15B | — | — | — | — | Available |
| Nemotron Lightning 3.5 | 1.0M | $0.050 | $0.200 | Current | |
| Nemotron 3.5 Lightning 30B | 1.0M | — | — | Available | |
| Nemotron 3 Ultra 550B A55B | 1.0M | $0.500 | $2.20 | Deprecated | |
| Nemotron 3.5 Content Safety | 131K | $0.200 | $0.200 | Available | |
| Nemotron Nano 3 30B A3B Omni Reasoning | 256K | — | — | Available | |
| Nemotron Super 3 120B | 256K | $0.150 | $0.650 | Available | |
| Nemotron Nano 3 30B | 262K | $0.060 | $0.240 | Available | |
| Nemotron Nano 3 30B A3B Omni | — | — | — | — | Available |
| Nemotron Nano 3 30B A3B Reasoning | — | — | — | — | Available |
| Nemotron Nano 3 4B | — | — | — | — | Available |