WizardLM 2 8x22B is Microsoft's language model with a 66K context window and up to 8K output tokens, available from 4 providers, starting at $0.48 / 1M input and $0.48 / 1M output. Microsoft's most capable WizardLM fine-tune built on a Mixtral 8x22B MoE backbone, targeting highly competitive instruction-following and reasoning performance.
Specifications
Canonical IDmicrosoft-wizardlm-2-8x22b
TypeLanguage
StatusActive
CreatorMicrosoftMicrosoft
Providers
Context Window66K tokens
Max Output8K tokens
Input ModalitiesText
Output ModalitiesText
Parameters22B
Release Date · 3 years ago
Knowledge Cutoff · 2 years ago

Capabilities

Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities1/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs✓
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Pricing by Provider

US Dollar ($)
Per 1M tokens
ProviderStandard
Input
$ / 1M
Output
$ / 1M
DeepInfra logo
DeepInfra
deepinfra/microsoft/WizardLM-2-8x22B
$0.48$0.48
Hugging Face logo
Hugging Face
novita:microsoft/wizardlm-2-8x22b
$0.62$0.62
Novita logo
Novita
novita/microsoft/wizardlm-2-8x22b
$0.62$0.62
OpenRouter logo
OpenRouter
microsoft/wizardlm-2-8x22b
$0.62$0.62

Cost Calculator

US Dollar ($)
Preset:

Cheapest Instances to Run It

Cloud GPU instances that can host WizardLM 2 8x22B, ranked by cheapest on-demand price. The model needs about 53 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
Standard_NP10sAzureAMD Alveo U250 FPGA (64GB)64 GB$1.65/hr
Standard_NV32as_v4AzureAMD Radeon Instinct MI2564 GB$1.86/hr
Standard_NP20sAzure2× AMD Alveo U250 FPGA (64GB)128 GB$3.30/hr
7 more instances can run WizardLM 2 8x22B
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Model IDs

deepinfra/microsoft/WizardLM-2-8x22B
huggingface-llm-alpindale-wizard-lm-2-8-22B
microsoft-wizardlm-2-8x22b
microsoft/wizardlm-2-8x22b
novita/microsoft/wizardlm-2-8x22b
openrouter/microsoft/wizardlm-2-8x22b