Llama V2 70B Chat

Llama V2 70B Chat is a text model from Fireworks AI with a context window of 2K tokens and max output of 2K tokens. Pricing starts at 0.90 per million input tokens and 0.90 per million output tokens (cheapest at Ollama).

Capabilities

Vision Function Calling Reasoning JSON Schema System Messages Web Search Prompt Caching Audio Input Audio Output

Specifications

Model Keyfireworks_ai/accounts/fireworks/models/llama-v2-70b-chat
ProviderFireworks AI
Provider IDfireworks_ai
ModeText
Canonical Namellama-2-70b
Context Window2K tokens
Max Output2K tokens

Pricing

TypePer 1K TokensPer 1M Tokens
Input Tokens0.0009000.900
Output Tokens0.0009000.900

Benchmarks

Intelligence Index8.4#211
MMLU-Pro0.4#180
GPQA0.3#192
HLE0.1#105
LiveCodeBench0.1#179
AIME0.0#127
Time to First Token0.00s#1
MATH-5000.3#132

Price Comparison by Provider

Compare prices for Llama V2 70B Chat across different providers. The same model may be available through multiple providers at different price points.

Provider
Model Key
Input Price, $
Output Price, $
Snowflakesnowflake/llama2-70b-chatN/AN/A
AWS SageMakersagemaker/meta-textgeneration-llama-2-70bN/AN/A
Replicatereplicate/meta/llama-2-70b0.6502.75
Perplexityperplexity/llama-2-70b-chat0.7002.80
Ollamaollama/llama2:70bN/AN/A
AWS Bedrockmeta.llama2-70b-chat-v11.952.56
Fireworks AIfireworks_ai/accounts/fireworks/models/llama-v2-70b0.1000.100
Databricksdatabricks/databricks-llama-2-70b-chat0.5001.50
Anyscaleanyscale/meta-llama/Llama-2-70b-chat-hf1.001.00

All Variants

All available versions, regions, and API endpoints for Llama V2 70B Chat.

Model Key
Provider
Mode
Input Price, $
Output Price, $
Context
Max Output
Vision
Functions
anyscale/meta-llama/Llama-2-70b-chat-hfAnyscaleText1.001.004K4Knono
meta.llama2-70b-chat-v1AWS BedrockText1.952.564K4Knono
sagemaker/meta-textgeneration-llama-2-70bAWS SageMakerTextN/AN/A4K4Knono
sagemaker/meta-textgeneration-llama-2-70b-b-fAWS SageMakerTextN/AN/A4K4Knono
databricks/databricks-llama-2-70b-chatDatabricksText0.5001.504K4Knono
fireworks_ai/accounts/fireworks/models/llama-v2-70bFireworks AIText0.1000.1004K4Knono
fireworks_ai/accounts/fireworks/models/llama-v2-70b-chatFireworks AIText0.9000.9002K2Knono
ollama/llama2:70bOllamaTextN/AN/A4K4Knono
perplexity/llama-2-70b-chatPerplexityText0.7002.804K4Knono
replicate/meta/llama-2-70bReplicateText0.6502.754K4Knono
replicate/meta/llama-2-70b-chatReplicateText0.6502.754K4Knono
snowflake/llama2-70b-chatSnowflakeTextN/AN/A4K8Knono