Llama 3.1 8B Instruct
WandbText
Llama 3.1 8B Instruct is a text model from Wandb with a context window of 128K tokens and max output of 128K tokens. Pricing starts at $0.02 per million input tokens and $0.02 per million output tokens (cheapest at Google Vertex AI).
Specifications
| Model Key | wandb/meta-llama/Llama-3.1-8B-Instruct |
| Provider | Wandb |
| LiteLLM Provider | wandb |
| Mode | Text |
| Canonical Name | llama-3.1-8b |
| Context Window | 128K tokens |
| Max Output | 128K tokens |
Capabilities
✗ Vision✗ Function Calling✗ Reasoning✗ JSON Schema✗ System Messages✗ Web Search✗ Prompt Caching✗ Audio Input✗ Audio Output
Pricing
| Type | Per 1K Tokens | Per 1M Tokens |
|---|---|---|
| Input Tokens | $0.000022 | $0.022 |
| Output Tokens | $0.000022 | $0.022 |
Price Comparison by Provider
Compare prices for Llama 3.1 8B Instruct across different providers. The same model may be available through multiple providers at different price points.
Provider | Model Key | Input Price | Output Price |
|---|---|---|---|
| Databricks | databricks/databricks-meta-llama-3-1-8b-instruct | $0.150 | $0.450 |
| Llamagate | llamagate/llama-3.1-8b | $0.030 | $0.050 |
| Vercel Ai Gateway | vercel_ai_gateway/meta/llama-3.1-8b | $0.050 | $0.080 |
| Groq | groq/llama-3.1-8b-instant | $0.050 | $0.080 |
| Novita | novita/meta-llama/llama-3.1-8b-instruct | $0.020 | $0.050 |
| Nscale | nscale/meta-llama/Llama-3.1-8B-Instruct | $0.030 | $0.030 |
| Ovhcloud | ovhcloud/Llama-3.1-8B-Instruct | $0.100 | $0.100 |
| Perplexity | perplexity/llama-3.1-8b-instruct | $0.200 | $0.200 |
| Wandb | wandb/meta-llama/Llama-3.1-8B-Instruct | $0.022 | $0.022 |
| Google Vertex AI | vertex_ai/meta/llama-3.1-8b-instruct-maas | N/A | N/A |
| Fireworks AI | fireworks_ai/accounts/fireworks/models/llama-v3p1-8b-instruct | $0.100 | $0.100 |
| AWS Bedrock | meta.llama3-1-8b-instruct-v1:0 | $0.220 | $0.220 |
| Cerebras | cerebras/llama3.1-8b | $0.100 | $0.100 |
| Snowflake | snowflake/llama3.1-8b | N/A | N/A |
| Lambda Ai | lambda_ai/llama3.1-8b-instruct | $0.025 | $0.040 |
| Azure AI | azure_ai/Meta-Llama-3.1-8B-Instruct | $0.300 | $0.610 |
| Deepinfra | deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct | $0.030 | $0.050 |
| Friendliai | friendliai/meta-llama-3.1-8b-instruct | $0.100 | $0.100 |
| Hyperbolic | hyperbolic/meta-llama/Meta-Llama-3.1-8B-Instruct | $0.120 | $0.300 |
| SambaNova | sambanova/Meta-Llama-3.1-8B-Instruct | $0.100 | $0.200 |
| Together AI | together_ai/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo | $0.180 | $0.180 |
Similar Models
Models with similar capabilities and context window size.
Model | Provider | Mode | Input Price | Output Price | Context | Max Output | Vision | Functions |
|---|---|---|---|---|---|---|---|---|
| Gemma 3 4B It GGUF | Lemonade | Text | N/A | N/A | 128K | 8K | no | yes |
| Gemma3 4B | Llamagate | Text | $0.030 | $0.080 | 128K | 8K | yes | yes |
| GigaChat 2 Lite | Gigachat | Text | N/A | N/A | 128K | 8K | no | yes |
| GigaChat 2 Max | Gigachat | Text | N/A | N/A | 128K | 8K | yes | yes |
| GigaChat 2 Pro | Gigachat | Text | N/A | N/A | 128K | 8K | yes | yes |
| Glm 4.5 Flash | Zai | Text | N/A | N/A | 128K | 32K | no | yes |
| Llama 3.1 70B Instruct Maas | Google Vertex AI | Text | N/A | N/A | 128K | 2K | yes | no |
| Llama 3.1 8B Instruct Maas | Google Vertex AI | Text | N/A | N/A | 128K | 2K | yes | no |
| Llama 3.2 90B Vision Instruct Maas | Google Vertex AI | Text | N/A | N/A | 128K | 2K | yes | no |
| Qwen3 4B Fp8 | Novita | Text | $0.030 | $0.030 | 128K | 20K | no | no |