Nemotron Lightning 3.5 30B A3B is NVIDIA's language model with a 262K context window and up to 33K output tokens, starting at $0.05 / 1M input and $0.2 / 1M output. A 30B-parameter mixture-of-experts Nemotron Lightning model with 3B active parameters, built on the Nemotron-H architecture for efficient high-throughput inference.
Specifications
Canonical IDnvidia-nemotron-lightning-3-5-30b-a3b
TypeLanguage
StatusActive
CreatorNVIDIANVIDIA
Providers
Context Window262K tokens
Max Output33K tokens
Input ModalitiesText
Output ModalitiesText
Reasoning Effortsdefault
Parameters30B

Capabilities

Input1/5
Text
Image·
Audio·
Video·
PDF·
Output1/5
Text
Image·
Audio·
Video·
Embedding·
Capabilities3/13
Reasoning
Adaptive Reasoning·
Function Calling
Parallel Function Calling·
Structured Outputs
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Pricing by Provider

US Dollar ($)
Per 1M tokens
ProviderStandard
Input
$ / 1M
Output
$ / 1M
Cache Read
$ / 1M
Fireworks AI logo
Fireworks AI
fireworks_ai/nemotron-lightning-3p5-30b-a3b
$0.05$0.2$0.01

Cost Calculator

US Dollar ($)
Preset:

Cheapest Instances to Run It

Cloud GPU instances that can host Nemotron Lightning 3.5 30B A3B, ranked by cheapest on-demand price. The model needs about 72 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
Standard_NP20sAzure2× AMD Alveo U250 FPGA (64GB)128 GB$3.30/hr
g7e.2xlargeAWSRTX PRO Server 600096 GB$3.36/hr
Standard_NC24ads_A100_v4AzureNVIDIA A10080 GB$3.67/hr
7 more instances can run Nemotron Lightning 3.5 30B A3B
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Nemotron Super 3 120B A12B1.0M$0.085$0.400Available
Nemotron Nano 3 30B A3B262K$0.050$0.200Available
Nemotron Lightning 3.5 30B A3B262K$0.050$0.200Current
Nemotron 3 Ultra262K$0.600$2.40Available
Nemotron Nano 2 9B131K$0.040$0.160Deprecated
Nemotron Nano 2 12B131K$0.200$0.200Available

Model IDs

accounts/fireworks/models/nemotron-lightning-3p5-30b-a3b
fireworks_ai/accounts/fireworks/models/nemotron-lightning-3p5-30b-a3b
fireworks_ai/nemotron-lightning-3p5-30b-a3b
huggingface-reasoning-nemotron-3-5-lightning-30b-a3b-bf16
huggingface-reasoning-nemotron-3-5-lightning-30b-a3b-nvfp4
nvidia-nemotron-lightning-3-5-30b-a3b