Nemotron 3.5 30B A3B Lightning is NVIDIA's language model with a 262K context window, starting at $0.1 / 1M input and $0.25 / 1M output. A mixture-of-experts large language model in the Nemotron series optimized for fast, low-latency inference at scale.
Specifications
Canonical IDnvidia-nemotron-3-5-30b-a3b-lightning
TypeLanguage
StatusActive
CreatorNVIDIANVIDIA
Providers
Context Window262K tokens
Input ModalitiesText
Output ModalitiesText
Parameters30B

Capabilities

Input1/5
Text
Image·
Audio·
Video·
PDF·
Output1/5
Text
Image·
Audio·
Video·
Embedding·
Capabilities1/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching
Assistant Prefill·

Pricing by Provider

US Dollar ($)
Per 1M tokens
ProviderStandard
Input
$ / 1M
Output
$ / 1M
Cache Read
$ / 1M
Weights & Biases logo
Weights & Biases
wandb/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B
$0.1$0.25$0.05

Cost Calculator

US Dollar ($)
Preset:

Cheapest Instances to Run It

Cloud GPU instances that can host Nemotron 3.5 30B A3B Lightning, ranked by cheapest on-demand price. The model needs about 72 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
Standard_NP20sAzure2× AMD Alveo U250 FPGA (64GB)128 GB$3.30/hr
g7e.2xlargeAWSRTX PRO Server 600096 GB$3.36/hr
Standard_NC24ads_A100_v4AzureNVIDIA A10080 GB$3.67/hr
7 more instances can run Nemotron 3.5 30B A3B Lightning
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Nemotron 4 15BAvailable
Nemotron Lightning 3.51.0M$0.050$0.200Available
Nemotron 3.5 Lightning 30B1.0MAvailable
Nemotron 3 Ultra 550B A55B1.0M$0.500$2.20Deprecated
Nemotron 3.5 Content Safety131K$0.200$0.200Available
Nemotron Nano 3 30B A3B Omni Reasoning256KAvailable
Nemotron Super 3 120B256K$0.150$0.650Available
Nemotron Nano 3 30B262K$0.060$0.240Available
Nemotron 3.5 30B A3B Lightning262K$0.100$0.250Current
Nemotron Nano 3 30B A3B OmniAvailable
Nemotron Nano 3 30B A3B ReasoningAvailable

Model IDs

nvidia-nemotron-3-5-30b-a3b-lightning
wandb/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B