Llama3.1 405B Instruct Fp8
Llama3.1 405B Instruct Fp8 is a text model from 
Lambda with a context window of 131K tokens and max output of 131K tokens. Pricing starts at 0.80 per million input tokens and 0.80 per million output tokens (cheapest at Fireworks AI).
Capabilities
✗ Vision✓ Function Calling✗ Reasoning✗ JSON Schema✓ System Messages✗ Web Search✗ Prompt Caching✗ Audio Input✗ Audio Output
Specifications
| Model Key | lambda_ai/llama3.1-405b-instruct-fp8 |
| Provider | Lambda |
| Provider ID | lambda_ai |
| Mode | Text |
| Canonical Name | llama-3.1-405b |
| Context Window | 131K tokens |
| Max Output | 131K tokens |
Pricing
| Type | Per 1K Tokens | Per 1M Tokens |
|---|---|---|
| Input Tokens | 0.000800 | 0.800 |
| Output Tokens | 0.000800 | 0.800 |
Price Comparison by Provider
Compare prices for Llama3.1 405B Instruct Fp8 across different providers. The same model may be available through multiple providers at different price points.
Provider | Model Key | Input Price, $ | Output Price, $ |
|---|---|---|---|
 Vertex AI (Llama) | vertex_ai/meta/llama-3.1-405b-instruct-maas | 5.00 | 16.00 |
 Together AI | together_ai/meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo | 3.50 | 3.50 |
 Snowflake | snowflake/snowflake-llama-3.1-405b | N/A | N/A |
 SambaNova | sambanova/Meta-Llama-3.1-405B-Instruct | 5.00 | 10.00 |
 Oracle Cloud (OCI) | oci/meta.llama-3.1-405b-instruct | 10.68 | 10.68 |
| Nebius | nebius/meta-llama/Meta-Llama-3.1-405B-Instruct | 1.00 | 3.00 |
 AWS Bedrock | meta.llama3-1-405b-instruct-v1:0 | 5.32 | 16.00 |
| Lambda | lambda_ai/llama3.1-405b-instruct-fp8 | 0.800 | 0.800 |
 Hyperbolic | hyperbolic/meta-llama/Meta-Llama-3.1-405B-Instruct | 0.120 | 0.300 |
 Fireworks AI | fireworks_ai/accounts/fireworks/models/llama-v3p1-405b-instruct-long | 0.100 | 0.100 |
 Databricks | databricks/databricks-meta-llama-3-1-405b-instruct | 5.00 | 15.00 |
 Azure AI | azure_ai/Meta-Llama-3.1-405B-Instruct | 5.33 | 16.00 |
All Variants
All available versions, regions, and API endpoints for Llama3.1 405B Instruct Fp8.