Hermes 3 Llama 3.1 405B
DeprecatesHermes 3 Llama 3.1 405B is Nous Research's language model with a 131K context window and up to 16K output tokens, available from 3 providers, starting at $1.00 / 1M input and $1.00 / 1M output. A 405B-parameter Llama 3.1-based LLM from Nous Research fine-tuned for advanced roleplaying, reasoning, and agentic multi-turn conversation.
| Specifications | |
|---|---|
nousresearch-hermes-3-llama-3-1-405b | |
| Language | |
| Deprecating | |
| Nous Research | |
| 131K tokens | |
| 16K tokens | |
| Text | |
| Text | |
| 405B | |
| · 2 years ago | |
| · 3 years ago | |
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities3/13
Reasoning·
Adaptive Reasoning·
Function Calling✓
Parallel Function Calling·
Structured Outputs✓
Native JSON Schema✓
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | |
|---|---|---|
| Input $ / 1M | Output $ / 1M | |
| $1.00 | $1.00 | |
| $1.00 | $3.00 | |
| $1.00 | $1.00 | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host Hermes 3 Llama 3.1 405B, ranked by cheapest on-demand price. The model needs about 972 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| Standard_ND96isr_MI300X_v5 |  Azure | 8× AMD Instinct MI300X | 1536 GB | $48.00/hr | westus3 | |
| p5en.48xlarge |  AWS | 8× H200 | 1128 GB | $63.30/hr | us-east-1 | |
| Standard_ND96isr_H200_v5 | Azure | 8× NVIDIA H200 GPU (141GB) | 1128 GB | $84.80/hr | westus2 | |
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Llama 3.3 70B Instruct | 131K | $0.120 | $0.200 | Deprecating | |
| Llama 3.2 3B Instruct | 131K | $0.015 | $0.020 | Deprecated | |
| Llama 3.2 1B Instruct | 131K | $0.027 | $0.080 | Deprecated | |
| Llama 3.2 11B | 128K | $0.160 | $0.160 | Available | |
| Llama 3.1 405B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 3.1 8B Instruct | 200K | $0.020 | $0.030 | Deprecated | |
| Llama 3.1 70B Instruct | 131K | $0.120 | $0.300 | Available | |
| Llama 3.1 70B | 128K | $0.360 | $0.360 | Available | |
| Llama 3.1 8B | 131K | $0.030 | $0.050 | Available | |
| Llama 3 70B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Hermes 3 Llama 3.1 405B | 131K | $1.00 | $1.00 | Current |