Meta logo

Code Llama 70B Instruct

Pricing & Specs API
Free REST API for prices, specs and benchmarks
Code Llama 70B Instruct is Meta's language model with a 16K context window and up to 16K output tokens, available from 3 providers, starting at $0.7 / 1M input and $0.9 / 1M output. A 70B-parameter instruction-tuned Code Llama model designed to follow natural language instructions for complex code generation tasks.
Specifications
Canonical IDmeta-codellama-70b-instruct
TypeLanguage
StatusActive
CreatorMetaMeta
Providers
Context Window16K tokens
Max Output16K tokens
Input ModalitiesText
Output ModalitiesText
Parameters70B

Capabilities

Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text✓
Image·
Audio·
Video·
Embedding·
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·

Pricing by Provider

US Dollar ($)
Per 1M tokens
ProviderStandard
Input
$ / 1M
Output
$ / 1M
Anyscale logo
Anyscale
anyscale/codellama/CodeLlama-70b-Instruct-hf
$1.00$1.00
Fireworks AI logo
Fireworks AI
fireworks_ai/accounts/fireworks/models/code-llama-70b-instruct
$0.9$0.9
Perplexity logo
Perplexity
perplexity/codellama-70b-instruct
$0.7$2.80

Cost Calculator

US Dollar ($)
Preset:

Cheapest Instances to Run It

Cloud GPU instances that can host Code Llama 70B Instruct, ranked by cheapest on-demand price. The model needs about 168 GB of GPU memory at FP16 precision (estimated from its parameter count), so treat the fit as guidance rather than a guarantee.

All clouds
FP16 (full precision)
US Dollar ($)
Instance
Cloud
GPU
VRAM
Price
Cheapest region
Standard_NP40sAzure4× AMD Alveo U250 FPGA (64GB)256 GB$6.60/hrwestus2
g2-standard-96GCP8× nvidia-l4192 GB$7.98/hrus-east4
g7e.12xlargeAWS2× RTX PRO Server 6000192 GB$8.29/hrus-east-1
7 more instances can run Code Llama 70B Instruct
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Versions

VersionReleasedContextInput / 1MOutput / 1MStatus
Llama 3.3 70B Instruct131K$0.120$0.200Deprecating
Llama 3.2 3B Instruct131K$0.015$0.020Deprecated
Llama 3.2 1B Instruct131K$0.027$0.080Deprecated
Llama 3.2 11B128K$0.160$0.160Available
Llama 3.1 405B Instruct131K$0.120$0.300Deprecated
Llama 3.1 8B Instruct200K$0.020$0.030Deprecated
Llama 3.1 70B Instruct131K$0.120$0.300Available
Llama 3.1 70B128K$0.360$0.360Available
Llama 3.1 8B131K$0.030$0.050Available
Llama 3 70B Instruct131K$0.120$0.300Deprecated
Code Llama 70B Instruct—16K$0.700$0.900Current

Model IDs

accounts/fireworks/models/code-llama-70b-instruct
anyscale/codellama/CodeLlama-70b-Instruct-hf
fireworks_ai/accounts/fireworks/models/code-llama-70b-instruct
meta-codellama-70b-instruct
meta-textgeneration-llama-codellama-70b-instruct
perplexity/codellama-70b-instruct