Meta Llama 3 70B Instruct

Meta Llama 3 70B Instruct is a text model from Anyscale with a context window of 8K tokens and max output of 8K tokens. Pricing starts at 1.00 per million input tokens and 1.00 per million output tokens (cheapest at Vertex AI (Llama)).

Capabilities

Vision Function Calling Reasoning JSON Schema System Messages Web Search Prompt Caching Audio Input Audio Output

Specifications

Model Keyanyscale/meta-llama/Meta-Llama-3-70B-Instruct
ProviderAnyscale
Provider IDanyscale
ModeText
Canonical Namellama-3-70b
Context Window8K tokens
Max Output8K tokens

Pricing

TypePer 1K TokensPer 1M Tokens
Input Tokens0.00101.00
Output Tokens0.00101.00

Benchmarks

Intelligence Index8.9#203
Coding Index6.8#151
MMLU-Pro0.6#150
GPQA0.4#178
HLE0.0#144
LiveCodeBench0.2#145
AIME0.0#127
IFBench0.4#98
Time to First Token0.44s#115
SciCode0.2#161
MATH-5000.5#120
LCR0.0#151
TerminalBench Hard0.0#138
TAU20.0#154

Price Comparison by Provider

Compare prices for Meta Llama 3 70B Instruct across different providers. The same model may be available through multiple providers at different price points.

Provider
Model Key
Input Price, $
Output Price, $
Vertex AI (Llama)vertex_ai/meta/llama3-70b-instruct-maasN/AN/A
Vercel AI Gatewayvercel_ai_gateway/meta/llama-3-70b0.5900.790
Snowflakesnowflake/llama3-70bN/AN/A
Replicatereplicate/meta/llama-3-70b-instruct0.6502.75
OpenRouteropenrouter/meta-llama/llama-3-70b-instruct0.5900.790
Ollamaollama/llama3:70bN/AN/A
Novita AInovita/meta-llama/llama-3-70b-instruct0.5100.740
AWS Bedrockmeta.llama3-70b-instruct-v1:02.653.50
Hyperbolichyperbolic/meta-llama/Meta-Llama-3-70B-Instruct0.1200.300
Fireworks AIfireworks_ai/accounts/fireworks/models/llama-v3-70b-instruct-hf0.9000.900
Databricksdatabricks/databricks-meta-llama-3-70b-instruct1.003.00
Azure AIazure_ai/Meta-Llama-3-70B-Instruct1.100.370
Anyscaleanyscale/meta-llama/Meta-Llama-3-70B-Instruct1.001.00

All Variants

All available versions, regions, and API endpoints for Meta Llama 3 70B Instruct.

Model Key
Provider
Mode
Input Price, $
Output Price, $
Context
Max Output
Vision
Functions
anyscale/meta-llama/Meta-Llama-3-70B-InstructAnyscaleText1.001.008K8Knono
bedrock/ap-south-1/meta.llama3-70b-instruct-v1:0AWS BedrockText3.184.208K8Knono
bedrock/ca-central-1/meta.llama3-70b-instruct-v1:0AWS BedrockText3.054.038K8Knono
bedrock/eu-west-1/meta.llama3-70b-instruct-v1:0AWS BedrockText2.863.788K8Knono
bedrock/eu-west-2/meta.llama3-70b-instruct-v1:0AWS BedrockText3.454.558K8Knono
bedrock/sa-east-1/meta.llama3-70b-instruct-v1:0AWS BedrockText4.455.888K8Knono
bedrock/us-east-1/meta.llama3-70b-instruct-v1:0AWS BedrockText2.653.508K8Knono
bedrock/us-gov-east-1/meta.llama3-70b-instruct-v1:0AWS BedrockText2.653.508K2Knono
bedrock/us-gov-west-1/meta.llama3-70b-instruct-v1:0AWS BedrockText2.653.508K2Knono
bedrock/us-west-1/meta.llama3-70b-instruct-v1:0AWS BedrockText2.653.508K8Knono
meta.llama3-70b-instruct-v1:0AWS BedrockText2.653.508K8Knono
azure_ai/Meta-Llama-3-70B-InstructAzure AIText1.100.3708K2Knono
databricks/databricks-meta-llama-3-70b-instructDatabricksText1.003.00128K128Knono
fireworks_ai/accounts/fireworks/models/llama-v3-70b-instructFireworks AIText0.9000.9008K8Knono
fireworks_ai/accounts/fireworks/models/llama-v3-70b-instruct-hfFireworks AIText0.9000.9008K8Knono
hyperbolic/meta-llama/Meta-Llama-3-70B-InstructHyperbolicText0.1200.300131K131Knoyes
novita/meta-llama/llama-3-70b-instructNovita AIText0.5100.7408K8Knono
ollama/llama3:70bOllamaTextN/AN/A8K8Knono
openrouter/meta-llama/llama-3-70b-instructOpenRouterText0.5900.7908KN/Anono
replicate/meta/llama-3-70bReplicateText0.6502.758K8Knono
replicate/meta/llama-3-70b-instructReplicateText0.6502.758K8Knono
snowflake/llama3-70bSnowflakeTextN/AN/A8K8Knono
vercel_ai_gateway/meta/llama-3-70bVercel AI GatewayText0.5900.7908K8Knono
vertex_ai/meta/llama3-70b-instruct-maasVertex AI (Llama)TextN/AN/A32K32Knono