Mixtral 8x7B Instruct
DeprecatedMixtral 8x7B Instruct is Mistral AI's language model with a 33K context window and up to 16K output tokens, available from 8 providers, starting at $0.07 / 1M input and $0.15 / 1M output. Instruction-tuned variant of the Mixtral 8x7B MoE model, optimized for following user instructions and conversational tasks.
| Specifications | |
|---|---|
mistral-mixtral-8x7b-instruct | |
| Language | |
| Deprecated | |
| Mistral AI | |
| 33K tokens | |
| 16K tokens | |
| Text | |
| Text | |
| 7B | |
| · 3 years ago | |
| · 3 years ago | |
| Benchmarks | |
|---|---|
| Intelligence Index | #539 |
| MMLU-Pro | #317 |
| GPQA | #502 |
| HLE | #420 |
| LiveCodeBench | #322 |
| AIME | #184 |
| Time to First Token | #435 |
| SciCode | #534 |
| MATH-500 | #183 |
| Output TPS | #242 |
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities4/13
Reasoning·
Adaptive Reasoning·
Function Calling✓
Parallel Function Calling✓
Structured Outputs✓
Native JSON Schema✓
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | |
|---|---|---|
| Input $ / 1M | Output $ / 1M | |
| $0.45 | $0.7 | |
| $0.15 | $0.15 | |
| $0.4 | $0.4 | |
| $0.5 | $0.5 | |
| $0.63 | $0.63 | |
| $0.07 | $0.28 | |
| $0.3 | $1.00 | |
| $0.6 | $0.6 | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host Mixtral 8x7B Instruct, ranked by cheapest on-demand price. The model needs about 17 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| g2-standard-4 |  GCP | nvidia-l4 | 24 GB | $0.705/hr | ||
| g6.xlarge |  AWS | L4 | 22 GB | $0.805/hr | ||
| g2-standard-8 | GCP | nvidia-l4 | 24 GB | $0.851/hr | ||
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Dolphin 2.5 Mixtral 8x7B | — | — | — | — | Available |
| Dolphin 2.6 Mixtral 8x7B | — | 33K | $0.500 | $0.500 | Available |
| Dolphin 2.7 Mixtral 8x7B | — | — | — | — | Available |
| MiniMax M2 | 1.0M | $0.255 | $1.02 | Deprecating | |
| Mixtral 8x22B Instruct | 66K | $0.600 | $0.600 | Available | |
| Mixtral 8x7B Instruct | 33K | $0.070 | $0.150 | Current | |
| Hermes 2 Mixtral 8x7B DPO | — | 33K | $0.500 | $0.500 | Deprecated |
| KARAKURI LM 8x7B Instruct | — | — | — | — | Available |
| Mixtral | — | — | — | — | Available |
| Mixtral 8x22B | — | 66K | $1.20 | $1.20 | Deprecated |
| Mixtral 8x7B | — | 33K | $0.500 | $0.500 | Deprecated |