Pythia 12B
Pythia 12B is EleutherAI's language model with a 2K context window and up to 2K output tokens, starting at $0.2 / 1M input and $0.2 / 1M output. A 12B-parameter LLM from EleutherAI's Pythia suite, deliberately designed to support interpretability and scientific research on large language models.
| Specifications | |
|---|---|
eleutherai-pythia-12b | |
| Language | |
| Active | |
| EleutherAI | |
| 2K tokens | |
| 2K tokens | |
| Text | |
| Text | |
| 12B | |
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Pricing by Provider
US Dollar ($)
Per 1M tokens
| Provider | Standard | |
|---|---|---|
| Input $ / 1M | Output $ / 1M | |
| $0.2 | $0.2 | |
Cost Calculator
US Dollar ($)
Preset:
Cheapest Instances to Run It
Cloud GPU instances that can host Pythia 12B, ranked by cheapest on-demand price. The model needs about 29 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.
All clouds
FP16 (full precision)
US Dollar ($)
Instance | Cloud | GPU | VRAM | Price | Cheapest region | |
|---|---|---|---|---|---|---|
| Standard_NV16as_v4 |  Azure | AMD Radeon Instinct MI25 | 32 GB | $0.932/hr | westus2 | |
| Standard_NP10s | Azure | AMD Alveo U250 FPGA (64GB) | 64 GB | $1.65/hr | westus2 | |
| g6e.xlarge |  AWS | L40S | 45 GB | $1.86/hr | us-east-1 | |
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Pythia 12B | — | 2K | $0.200 | $0.200 | Current |
| Pythia 160M Deduped | — | — | — | — | Available |
| Pythia 70M Deduped | — | — | — | — | Available |