WizardLM 2 8x22B is Microsoft's language model with a 66K context window and up to 8K output tokens, available from 4 providers, starting at $0.48 / 1M input and $0.48 / 1M output. Microsoft's most capable WizardLM fine-tune built on a Mixtral 8x22B MoE backbone, targeting highly competitive instruction-following and reasoning performance.
Specifications
Canonical IDmicrosoft-wizardlm-2-8x22b
TypeLanguage
StatusActive
CreatorMicrosoftMicrosoft
Providers
Context Window66K tokens
Max Output8K tokens
Input ModalitiesText
Output ModalitiesText
Parameters22B
Release Date · 2 years ago
Knowledge Cutoff · 2 years ago

Capabilities

Input1/5
Text
Image·
Audio·
Video·
PDF·
Output1/5
Text
Image·
Audio·
Video·
Embedding·
Capabilities1/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Pricing by Provider

US Dollar ($)
Per 1M tokens
ProviderStandard
Input
$ / 1M
Output
$ / 1M
DeepInfra logo
DeepInfra
deepinfra/microsoft/WizardLM-2-8x22B
$0.48$0.48
Hugging Face logo
Hugging Face
novita:microsoft/wizardlm-2-8x22b
$0.62$0.62
Novita logo
Novita
novita/microsoft/wizardlm-2-8x22b
$0.62$0.62
OpenRouter logo
OpenRouter
microsoft/wizardlm-2-8x22b
$0.62$0.62

Cost Calculator

US Dollar ($)
Preset:

Cheapest Instances to Run It

Cloud GPU instances that can host WizardLM 2 8x22B, ranked by cheapest on-demand price. The model needs about 53 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
Standard_NP10sAzureAMD Alveo U250 FPGA (64GB)64 GB$1.65/hrwestus2
Standard_NV32as_v4AzureAMD Radeon Instinct MI2564 GB$1.86/hrwestus2
Standard_NP20sAzure2× AMD Alveo U250 FPGA (64GB)128 GB$3.30/hrwestus2
7 more instances can run WizardLM 2 8x22B
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Model IDs

deepinfra/microsoft/WizardLM-2-8x22B
huggingface-llm-alpindale-wizard-lm-2-8-22B
microsoft-wizardlm-2-8x22b
microsoft/wizardlm-2-8x22b
novita/microsoft/wizardlm-2-8x22b