Meta Llama 3.1 405B Instruct
SambaNovaText
Meta Llama 3.1 405B Instruct is a text model from SambaNova with a context window of 16K tokens and max output of 16K tokens. Pricing starts at $5.00 per million input tokens and $10.00 per million output tokens (cheapest at Fireworks AI).
Specifications
| Model Key | sambanova/Meta-Llama-3.1-405B-Instruct |
| Provider | SambaNova |
| LiteLLM Provider | sambanova |
| Mode | Text |
| Canonical Name | llama-3.1-405b |
| Context Window | 16K tokens |
| Max Output | 16K tokens |
Capabilities
✗ Vision✓ Function Calling✗ Reasoning✓ JSON Schema✗ System Messages✗ Web Search✗ Prompt Caching✗ Audio Input✗ Audio Output
Pricing
| Type | Per 1K Tokens | Per 1M Tokens |
|---|---|---|
| Input Tokens | $0.0050 | $5.00 |
| Output Tokens | $0.010 | $10.00 |
Price Comparison by Provider
Compare prices for Meta Llama 3.1 405B Instruct across different providers. The same model may be available through multiple providers at different price points.
Provider | Model Key | Input Price | Output Price |
|---|---|---|---|
| Databricks | databricks/databricks-meta-llama-3-1-405b-instruct | $5.00 | $15.00 |
| Oci | oci/meta.llama-3.1-405b-instruct | $10.68 | $10.68 |
| Google Vertex AI | vertex_ai/meta/llama-3.1-405b-instruct-maas | $5.00 | $16.00 |
| Fireworks AI | fireworks_ai/accounts/fireworks/models/llama-v3p1-405b-instruct-long | $0.100 | $0.100 |
| Lambda Ai | lambda_ai/llama3.1-405b-instruct-fp8 | $0.800 | $0.800 |
| Azure AI | azure_ai/Meta-Llama-3.1-405B-Instruct | $5.33 | $16.00 |
| Hyperbolic | hyperbolic/meta-llama/Meta-Llama-3.1-405B-Instruct | $0.120 | $0.300 |
| SambaNova | sambanova/Meta-Llama-3.1-405B-Instruct | $5.00 | $10.00 |
| Together AI | together_ai/meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo | $3.50 | $3.50 |
| Snowflake | snowflake/snowflake-llama-3.1-405b | N/A | N/A |
| AWS Bedrock | us.meta.llama3-1-405b-instruct-v1:0 | $5.32 | $16.00 |
Similar Models
Models with similar capabilities and context window size.
Model | Provider | Mode | Input Price | Output Price | Context | Max Output | Vision | Functions |
|---|---|---|---|---|---|---|---|---|
| Codellama 7B | Llamagate | Text | $0.060 | $0.120 | 16K | 4K | no | yes |
| DeepSeek Coder 6.7B | Llamagate | Text | $0.060 | $0.120 | 16K | 4K | no | yes |
| Llama 3.1 8B Instruct | Novita | Text | $0.020 | $0.050 | 16K | 16K | no | no |
| Llama 4 Scout 17B 16e Instruct | Lambda Ai | Text | $0.050 | $0.100 | 16K | 8K | no | yes |
| Meta Llama 3.1 8B Instruct | SambaNova | Text | $0.100 | $0.200 | 16K | 16K | no | yes |
| Meta Llama 3.2 1B Instruct | SambaNova | Text | $0.040 | $0.080 | 16K | 16K | no | no |
| Paddleocr Vl | Novita | Text | $0.020 | $0.020 | 16K | 16K | yes | no |
| Phi 4 | Deepinfra | Text | $0.070 | $0.140 | 16K | 16K | no | no |
| Salamandra 7B Instruct Tools 16K | Publicai | Text | N/A | N/A | 16K | 4K | no | yes |
| Sonar Small Chat | Perplexity | Text | $0.070 | $0.280 | 16K | 16K | no | no |