Llama 3.1 8B Instruct Fast
Llama 3.1 8B Instruct Fast is Meta's language model with a 131K context window and up to 8K output tokens, starting at $0.15 / 1M input and $0.28 / 1M output. An instruction-tuned large language model in the Llama 3.1 series optimized for fast inference at an 8B parameter scale.
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities2/13
Reasoning·
Adaptive Reasoning·
Function Calling✓
Parallel Function Calling·
Structured Outputs✓
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | ||
|---|---|---|---|
| Input $ / 1M | Output $ / 1M | Cache Read $ / 1M | |
| $0.15 | $0.28 | $0.025 | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host Llama 3.1 8B Instruct Fast, ranked by cheapest on-demand price. The model needs about 19 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| g2-standard-4 |  GCP | nvidia-l4 | 24 GB | $0.705/hr | ||
| g6.xlarge |  AWS | L4 | 22 GB | $0.805/hr | ||
| g2-standard-8 | GCP | nvidia-l4 | 24 GB | $0.851/hr | ||
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Llama 3.2 11B | 128K | $0.160 | $0.160 | Available | |
| Llama 3.2 11B Instruct | 128K | $0.160 | $0.160 | Deprecated | |
| Llama 3.2 1B | 131K | $0.050 | $0.050 | Available | |
| Llama 3.2 1B Instruct | 131K | $0.020 | $0.020 | Deprecated | |
| Llama 3.2 3B | 131K | $0.040 | $0.075 | Available | |
| Llama 3.2 3B Instruct | 131K | $0.015 | $0.020 | Deprecated | |
| Llama 3.1 405B Instruct | 131K | $0.120 | $0.300 | Deprecated | |
| Llama 3.1 70B | 128K | $0.360 | $0.360 | Deprecated | |
| Llama 3.1 70B Instruct | 131K | $0.100 | $0.100 | Deprecated | |
| Llama 3.1 8B | 131K | $0.030 | $0.050 | Deprecated | |
| Llama 3.1 8B Instruct Fast | — | 131K | $0.150 | $0.280 | Current |