Nemotron 3.5 Bolt 74B-A9B
Nemotron 3.5 Bolt 74B-A9B is NVIDIA's language model. A Mixture-of-Experts language model from NVIDIA's Nemotron series with 74B total and 9B active parameters, tuned for fast inference under the Bolt variant.
| Benchmarks | |
|---|---|
| Intelligence Index | #160 |
| HLE | #121 |
| Time to First Token | #253 |
| SciCode | #181 |
| LCR | #153 |
| Output TPS | #493 |
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Cheapest Instances to Run It
Cloud GPU instances that can host Nemotron 3.5 Bolt 74B-A9B, ranked by cheapest on-demand price. The model needs about 178 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| Standard_NP40s |  Azure | 4× AMD Alveo U250 FPGA (64GB) | 256 GB | $6.60/hr | ||
| g2-standard-96 |  GCP | 8× nvidia-l4 | 192 GB | $7.98/hr | ||
| g7e.12xlarge |  AWS | 2× RTX PRO Server 6000 | 192 GB | $8.29/hr | ||
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Nemotron 4 15B | — | — | — | — | Available |
| Nemotron 3.5 Super VL | 1.0M | $0.150 | $0.500 | Available | |
| Nemotron 3.5 Lightning 30B | 1.0M | — | — | Available | |
| Nemotron Lightning 3.5 | 1.0M | $0.050 | $0.200 | Available | |
| Nemotron 3 Ultra 550B A55B | 1.0M | $0.250 | $2.15 | Deprecated | |
| Nemotron 3.5 Content Safety | 131K | $0.200 | $0.200 | Available | |
| Nemotron Nano 3 30B A3B Omni Reasoning | 256K | — | — | Available | |
| Nemotron Super 3 120B | 256K | $0.150 | $0.650 | Available | |
| Nemotron Nano 3 30B | 262K | $0.060 | $0.240 | Available | |
| Nemotron 3.5 Bolt 74B-A9B | — | — | — | — | Current |
| Nemotron Nano 3 30B A3B Reasoning | — | — | — | — | Available |