WizardLM 2 8x22B is Microsoft's language model with a 66K context window and up to 8K output tokens, available from 4 providers, starting at $0.48 / 1M input and $0.48 / 1M output. Microsoft's most capable WizardLM fine-tune built on a Mixtral 8x22B MoE backbone, targeting highly competitive instruction-following and reasoning performance.
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities1/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs✓
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | |
|---|---|---|
| Input $ / 1M | Output $ / 1M | |
| $0.48 | $0.48 | |
| $0.62 | $0.62 | |
| $0.62 | $0.62 | |
| $0.62 | $0.62 | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host WizardLM 2 8x22B, ranked by cheapest on-demand price. The model needs about 53 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| Standard_NP10s | AMD Alveo U250 FPGA (64GB) | 64 GB | $1.65/hr | westus2 | ||
| Standard_NV32as_v4 | AMD Radeon Instinct MI25 | 64 GB | $1.86/hr | westus2 | ||
| Standard_NP20s | 2× AMD Alveo U250 FPGA (64GB) | 128 GB | $3.30/hr | westus2 | ||