Llama 3.1 70B
Vercel Ai GatewayText
Llama 3.1 70B is a text model from Vercel Ai Gateway with a context window of 128K tokens and max output of 8K tokens. Pricing starts at $0.72 per million input tokens and $0.72 per million output tokens (cheapest at Google Vertex AI).
Specifications
| Model Key | vercel_ai_gateway/meta/llama-3.1-70b |
| Provider | Vercel Ai Gateway |
| LiteLLM Provider | vercel_ai_gateway |
| Mode | Text |
| Canonical Name | llama-3.1-70b |
| Context Window | 128K tokens |
| Max Output | 8K tokens |
Capabilities
✗ Vision✗ Function Calling✗ Reasoning✗ JSON Schema✗ System Messages✗ Web Search✗ Prompt Caching✗ Audio Input✗ Audio Output
Pricing
| Type | Per 1K Tokens | Per 1M Tokens |
|---|---|---|
| Input Tokens | $0.000720 | $0.720 |
| Output Tokens | $0.000720 | $0.720 |
Price Comparison by Provider
Compare prices for Llama 3.1 70B across different providers. The same model may be available through multiple providers at different price points.
Provider | Model Key | Input Price | Output Price |
|---|---|---|---|
| Vercel Ai Gateway | vercel_ai_gateway/meta/llama-3.1-70b | $0.720 | $0.720 |
| Perplexity | perplexity/llama-3.1-70b-instruct | $1.00 | $1.00 |
| Google Vertex AI | vertex_ai/meta/llama-3.1-70b-instruct-maas | N/A | N/A |
| Fireworks AI | fireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct | $0.900 | $0.900 |
| Cerebras | cerebras/llama3.1-70b | $0.600 | $0.600 |
| Snowflake | snowflake/llama3.1-70b | N/A | N/A |
| Lambda Ai | lambda_ai/llama3.1-70b-instruct-fp8 | $0.120 | $0.300 |
| Ovhcloud | ovhcloud/Meta-Llama-3_1-70B-Instruct | $0.670 | $0.670 |
| Azure AI | azure_ai/Meta-Llama-3.1-70B-Instruct | $2.68 | $3.54 |
| Deepinfra | deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct | $0.400 | $0.400 |
| Friendliai | friendliai/meta-llama-3.1-70b-instruct | $0.600 | $0.600 |
| Hyperbolic | hyperbolic/meta-llama/Meta-Llama-3.1-70B-Instruct | $0.120 | $0.300 |
| Together AI | together_ai/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo | $0.880 | $0.880 |
| AWS Bedrock | us.meta.llama3-1-70b-instruct-v1:0 | $0.990 | $0.990 |
Similar Models
Models with similar capabilities and context window size.
Model | Provider | Mode | Input Price | Output Price | Context | Max Output | Vision | Functions |
|---|---|---|---|---|---|---|---|---|
| Gemma 3 4B It GGUF | Lemonade | Text | N/A | N/A | 128K | 8K | no | yes |
| Gemma3 4B | Llamagate | Text | $0.030 | $0.080 | 128K | 8K | yes | yes |
| GigaChat 2 Lite | Gigachat | Text | N/A | N/A | 128K | 8K | no | yes |
| GigaChat 2 Max | Gigachat | Text | N/A | N/A | 128K | 8K | yes | yes |
| GigaChat 2 Pro | Gigachat | Text | N/A | N/A | 128K | 8K | yes | yes |
| Glm 4.5 Flash | Zai | Text | N/A | N/A | 128K | 32K | no | yes |
| Llama 3.1 70B Instruct Maas | Google Vertex AI | Text | N/A | N/A | 128K | 2K | yes | no |
| Llama 3.1 8B Instruct Maas | Google Vertex AI | Text | N/A | N/A | 128K | 2K | yes | no |
| Llama 3.2 90B Vision Instruct Maas | Google Vertex AI | Text | N/A | N/A | 128K | 2K | yes | no |
| Qwen3 4B Fp8 | Novita | Text | $0.030 | $0.030 | 128K | 20K | no | no |