NVIDIA logo

NVIDIA Llama 3.1 Nemotron 70B Instruct


NVIDIA Llama 3.1 Nemotron 70B Instruct is NVIDIA logoNVIDIA's language model with a 131K context window and up to 16K output tokens, available from 4 providers, starting at $0.120 / 1M input and $0.300 / 1M output. A 70B-parameter instruction-tuned LLM built on Llama 3.1 and post-trained by NVIDIA with reinforcement learning for precise, helpful responses.
Spec
Canonical IDnvidia-llama-3-1-nemotron-70b-instruct
TypeLanguage
StatusActive
CreatorNVIDIANVIDIA
Providers
Context Window131K tokens
Max Output16K tokens
Input ModalitiesText
Output ModalitiesText
Parameters70B
Release Date · 2 years ago
Intelligence Index
13.4
#212
Coding Index
10.8
#185
Math Index
11.0
#165
MMLU-Pro
0.7
#158
GPQA
0.5
#218
HLE
0.0
#214
LiveCodeBench
0.2
#207
AIME
0.2
#64
IFBench
0.3
#214
Time to First Token
0.41s
#163
SciCode
0.2
#205
MATH-500
0.7
#93
AIME 2025
0.1
#165
LCR
0.1
#198
TerminalBench Hard
0.0
#158
TAU2
0.2
#168
Output TPS
36.0
#174

Capabilities

Input1/5
Text
Image·
Audio·
Video·
PDF·
Output1/5
Text
Image·
Audio·
Video·
Embedding·
Capabilities2/13
Reasoning·
Adaptive Reasoning·
Function Calling
Parallel Function Calling
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Pricing by Provider

ProviderStandard
Input
$ / 1M
Output
$ / 1M
Lambda logo
Lambda
llama3.1-nemotron-70b-instruct-fp8
$0.120$0.300
DeepInfra logo
DeepInfra
nvidia/Llama-3.1-Nemotron-70B-Instruct
$0.600$0.600
Fireworks AI logo
Fireworks AI
accounts/fireworks/models/llama-v3p1-nemotron-70b-instruct
$0.900$0.900
OpenRouter logo
OpenRouter
nvidia/llama-3.1-nemotron-70b-instruct
$1.20$1.20

Cost Calculator

Preset:
Compares every provider & tier in USD

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Llama 3.3 70B Instruct131K$0.720$0.720Available
Llama 3.3 70B Instruct131K$0.100$0.300Available
Llama 3.3Available
Llama 3.3 70B Instruct Turbo131K$0.130$0.390Available
Llama 3.3 70B Versatile128K$0.590$0.790Available
Llama 3.3 8B Instruct128KAvailable
Llama 3.2 11B Vision Instruct128K$0.160$0.160Available
Llama 3.2 1B Instruct128K$0.027$0.080Deprecated
Llama 3.2 3B Instruct131K$0.015$0.020Deprecated
Llama 3.2 90B Vision Instruct128K$0.720$0.720Available
NVIDIA Llama 3.1 Nemotron 70B Instruct131K$0.120$0.300Current

Model IDs