Llama3.1 70B Instruct Fp8
Lambda AiText
Llama3.1 70B Instruct Fp8 is a text model from Lambda Ai with a context window of 131K tokens and max output of 131K tokens. Pricing starts at $0.12 per million input tokens and $0.30 per million output tokens (cheapest at Google Vertex AI).
Specifications
| Model Key | lambda_ai/llama3.1-70b-instruct-fp8 |
| Provider | Lambda Ai |
| LiteLLM Provider | lambda_ai |
| Mode | Text |
| Canonical Name | llama-3.1-70b |
| Context Window | 131K tokens |
| Max Output | 131K tokens |
Capabilities
✗ Vision✓ Function Calling✗ Reasoning✗ JSON Schema✓ System Messages✗ Web Search✗ Prompt Caching✗ Audio Input✗ Audio Output
Pricing
| Type | Per 1K Tokens | Per 1M Tokens |
|---|---|---|
| Input Tokens | $0.000120 | $0.120 |
| Output Tokens | $0.000300 | $0.300 |
Price Comparison by Provider
Compare prices for Llama3.1 70B Instruct Fp8 across different providers. The same model may be available through multiple providers at different price points.
Provider | Model Key | Input Price | Output Price |
|---|---|---|---|
| Vercel Ai Gateway | vercel_ai_gateway/meta/llama-3.1-70b | $0.720 | $0.720 |
| Perplexity | perplexity/llama-3.1-70b-instruct | $1.00 | $1.00 |
| Google Vertex AI | vertex_ai/meta/llama-3.1-70b-instruct-maas | N/A | N/A |
| Fireworks AI | fireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct | $0.900 | $0.900 |
| Cerebras | cerebras/llama3.1-70b | $0.600 | $0.600 |
| Snowflake | snowflake/llama3.1-70b | N/A | N/A |
| Lambda Ai | lambda_ai/llama3.1-70b-instruct-fp8 | $0.120 | $0.300 |
| Ovhcloud | ovhcloud/Meta-Llama-3_1-70B-Instruct | $0.670 | $0.670 |
| Azure AI | azure_ai/Meta-Llama-3.1-70B-Instruct | $2.68 | $3.54 |
| Deepinfra | deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct | $0.400 | $0.400 |
| Friendliai | friendliai/meta-llama-3.1-70b-instruct | $0.600 | $0.600 |
| Hyperbolic | hyperbolic/meta-llama/Meta-Llama-3.1-70B-Instruct | $0.120 | $0.300 |
| Together AI | together_ai/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo | $0.880 | $0.880 |
| AWS Bedrock | us.meta.llama3-1-70b-instruct-v1:0 | $0.990 | $0.990 |
Similar Models
Models with similar capabilities and context window size.
Model | Provider | Mode | Input Price | Output Price | Context | Max Output | Vision | Functions |
|---|---|---|---|---|---|---|---|---|
| Gemma 3 27B It | Google Gemini | Text | N/A | N/A | 131K | 8K | yes | yes |
| GPT-oss-120b-mxfp-GGUF | Lemonade | Text | N/A | N/A | 131K | 33K | no | yes |
| GPT-oss-20b | OpenRouter | Text | $0.020 | $0.100 | 131K | 33K | no | yes |
| GPT-oss-20b-mxfp4-GGUF | Lemonade | Text | N/A | N/A | 131K | 33K | no | yes |
| GPT-oss:120b-cloud | Ollama | Text | N/A | N/A | 131K | 131K | no | yes |
| GPT-oss:20b-cloud | Ollama | Text | N/A | N/A | 131K | 131K | no | yes |
| Llama3.2 11B Vision Instruct | Lambda Ai | Text | $0.015 | $0.025 | 131K | 131K | yes | yes |
| Llama3.2 3B Instruct | Lambda Ai | Text | $0.015 | $0.025 | 131K | 131K | no | yes |
| Meta Llama 3.1 8B Instruct Turbo | Deepinfra | Text | $0.020 | $0.030 | 131K | 131K | no | no |
| Mistral Nemo Instruct 2407 | Deepinfra | Text | $0.020 | $0.040 | 131K | 131K | no | no |