Nous Research logo

Hermes 3 Llama 3.1 70B

Pricing & Specs API
Free REST API for prices, specs and benchmarks
Hermes 3 Llama 3.1 70B is Nous Research's language model with a 131K context window and up to 16K output tokens, available from 3 providers, starting at $0.12 / 1M input and $0.3 / 1M output. A 70B-parameter Llama 3.1-based LLM from Nous Research with Hermes 3 fine-tuning for improved agentic capabilities and long-context coherence.
Specifications
Canonical IDnousresearch-hermes-3-llama-3-1-70b
TypeLanguage
StatusActive
CreatorNous ResearchNous Research
Providers
Context Window131K tokens
Max Output16K tokens
Input ModalitiesText
Output ModalitiesText
Parameters70B
HuggingFace Likes123
HuggingFace Downloads (30d)2,494
HuggingFace Downloads (all-time)179,146
Release Date · 2 years ago
Knowledge Cutoff · 3 years ago
Benchmarks
Intelligence Index
#480
MMLU-Pro
#275
GPQA
#452
HLE
#490
LiveCodeBench
#268
AIME
#165
Time to First Token
#506
SciCode
#413
MATH-500
#161
Output TPS
#239

Capabilities

Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities4/13
Reasoning·
Adaptive Reasoning·
Function Calling✓
Parallel Function Calling✓
Structured Outputs✓
Native JSON Schema✓
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Pricing by Provider

US Dollar ($)
Per 1M tokens
ProviderStandard
Input
$ / 1M
Output
$ / 1M
DeepInfra logo
DeepInfra
deepinfra/NousResearch/Hermes-3-Llama-3.1-70B
$0.7$0.7
Hyperbolic logo
Hyperbolic
hyperbolic/NousResearch/Hermes-3-Llama-3.1-70B
$0.12$0.3
OpenRouter logo
OpenRouter
nousresearch/hermes-3-llama-3.1-70b
$0.7$0.7

Cost Calculator

US Dollar ($)
Preset:

Cheapest Instances to Run It

Cloud GPU instances that can host Hermes 3 Llama 3.1 70B, ranked by cheapest on-demand price. The model needs about 168 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
Standard_NP40sAzure4× AMD Alveo U250 FPGA (64GB)256 GB$6.60/hr
g2-standard-96GCP8× nvidia-l4192 GB$7.98/hr
g7e.12xlargeAWS2× RTX PRO Server 6000192 GB$8.29/hr
7 more instances can run Hermes 3 Llama 3.1 70B
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Llama 3.3 70B Instruct131K$0.120$0.200Deprecated
Llama 3.2 3B Instruct131K$0.015$0.020Deprecated
Llama 3.2 1B Instruct131K$0.020$0.020Deprecated
Llama 3.1 405B Instruct131K$0.120$0.300Deprecated
Llama 3.1 8B Instruct200K$0.020$0.030Deprecated
Llama 3.1 70B Instruct131K$0.100$0.100Deprecated
Llama 3.1 70B128K$0.360$0.360Available
Llama 3.1 8B131K$0.030$0.050Available
Llama 3 70B Instruct131K$0.120$0.300Deprecated
Llama 3 8B Instruct32K$0.030$0.040Deprecated
Hermes 3 Llama 3.1 70B131K$0.120$0.300Current

Model IDs

deepinfra/NousResearch/Hermes-3-Llama-3.1-70B
hermes-3-llama-3-1-70b
hyperbolic/NousResearch/Hermes-3-Llama-3.1-70B
nousresearch-hermes-3-llama-3-1-70b
nousresearch/hermes-3-llama-3.1-70b
NousResearch/Hermes-3-Llama-3.1-70B
openrouter/nousresearch/hermes-3-llama-3.1-70b