Hermes 4 Llama 3.1 70B
Hermes 4 Llama 3.1 70B is Nous Research's language model. A 70B-parameter Llama 3.1-based hybrid reasoning LLM from Nous Research supporting both deliberate thinking and direct instruction-following.
| Specifications | |
|---|---|
nousresearch-hermes-4-llama-3-1-70b | |
| Language | |
| Active | |
| Nous Research | |
| Text | |
| Text | |
| 70B | |
| Benchmarks | |
|---|---|
| Intelligence Index | #371 |
| Math Index | #132 |
| MMLU-Pro | #103 |
| GPQA | #270 |
| HLE | #254 |
| LiveCodeBench | #116 |
| IFBench | #356 |
| Time to First Token | #233 |
| SciCode | #267 |
| AIME 2025 | #132 |
| LCR | #380 |
| TerminalBench Hard | #284 |
| TAU2 | #312 |
| Output TPS | #462 |
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Cheapest Instances to Run It
Cloud GPU instances that can host Hermes 4 Llama 3.1 70B, ranked by cheapest on-demand price. The model needs about 168 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| Standard_NP40s |  Azure | 4× AMD Alveo U250 FPGA (64GB) | 256 GB | $6.60/hr | ||
| g7e.12xlarge |  AWS | 2× RTX PRO Server 6000 | 192 GB | $8.29/hr | ||
| g6e.12xlarge | AWS | 4× L40S | 179 GB | $10.49/hr | ||
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Llama 3.3 70B Instruct | 131K | $0.100 | $0.200 | Deprecated | |
| Llama 3.2 3B Instruct | 131K | $0.015 | $0.020 | Deprecated | |
| Llama 3.2 1B Instruct | 131K | $0.020 | $0.020 | Deprecated | |
| Llama 3.1 405B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 3.1 8B Instruct | 200K | $0.020 | $0.030 | Deprecated | |
| Llama 3.1 70B Instruct | 131K | $0.100 | $0.100 | Deprecated | |
| Llama 3.1 70B | 128K | $0.360 | $0.360 | Available | |
| Llama 3.1 8B | 131K | $0.030 | $0.050 | Available | |
| Llama 3 70B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 3 8B Instruct | 32K | $0.030 | $0.040 | Deprecated | |
| Hermes 4 Llama 3.1 70B | — | — | — | — | Current |