Llama2 70B Chat

Llama2 70B Chat is a text model from Snowflake with a context window of 4K tokens and max output of 8K tokens.

Capabilities

Vision Function Calling Reasoning JSON Schema System Messages Web Search Prompt Caching Audio Input Audio Output

Specifications

Model Keysnowflake/llama2-70b-chat
ProviderSnowflake
Provider IDsnowflake
ModeText
Canonical Namellama-2-70b
Context Window4K tokens
Max Output8K tokens

Pricing

TypePer 1K TokensPer 1M Tokens
Input TokensN/AN/A
Output TokensN/AN/A

Benchmarks

Intelligence Index8.4#211
MMLU-Pro0.4#180
GPQA0.3#192
HLE0.1#105
LiveCodeBench0.1#179
AIME0.0#127
Time to First Token0.00s#1
MATH-5000.3#132

Price Comparison by Provider

Compare prices for Llama2 70B Chat across different providers. The same model may be available through multiple providers at different price points.

Provider
Model Key
Input Price, $
Output Price, $
Snowflakesnowflake/llama2-70b-chatN/AN/A
AWS SageMakersagemaker/meta-textgeneration-llama-2-70bN/AN/A
Replicatereplicate/meta/llama-2-70b0.6502.75
Perplexityperplexity/llama-2-70b-chat0.7002.80
Ollamaollama/llama2:70bN/AN/A
AWS Bedrockmeta.llama2-70b-chat-v11.952.56
Fireworks AIfireworks_ai/accounts/fireworks/models/llama-v2-70b0.1000.100
Databricksdatabricks/databricks-llama-2-70b-chat0.5001.50
Anyscaleanyscale/meta-llama/Llama-2-70b-chat-hf1.001.00

All Variants

All available versions, regions, and API endpoints for Llama2 70B Chat.

Model Key
Provider
Mode
Input Price, $
Output Price, $
Context
Max Output
Vision
Functions
anyscale/meta-llama/Llama-2-70b-chat-hfAnyscaleText1.001.004K4Knono
meta.llama2-70b-chat-v1AWS BedrockText1.952.564K4Knono
sagemaker/meta-textgeneration-llama-2-70bAWS SageMakerTextN/AN/A4K4Knono
sagemaker/meta-textgeneration-llama-2-70b-b-fAWS SageMakerTextN/AN/A4K4Knono
databricks/databricks-llama-2-70b-chatDatabricksText0.5001.504K4Knono
fireworks_ai/accounts/fireworks/models/llama-v2-70bFireworks AIText0.1000.1004K4Knono
fireworks_ai/accounts/fireworks/models/llama-v2-70b-chatFireworks AIText0.9000.9002K2Knono
ollama/llama2:70bOllamaTextN/AN/A4K4Knono
perplexity/llama-2-70b-chatPerplexityText0.7002.804K4Knono
replicate/meta/llama-2-70bReplicateText0.6502.754K4Knono
replicate/meta/llama-2-70b-chatReplicateText0.6502.754K4Knono
snowflake/llama2-70b-chatSnowflakeTextN/AN/A4K8Knono