Meta Llama 3.1 70B Instruct

FriendliaiText

Meta Llama 3.1 70B Instruct is a text model from Friendliai with a context window of 8K tokens and max output of 8K tokens. Pricing starts at $0.60 per million input tokens and $0.60 per million output tokens (cheapest at Google Vertex AI).

Specifications

Model Keyfriendliai/meta-llama-3.1-70b-instruct
ProviderFriendliai
LiteLLM Providerfriendliai
ModeText
Canonical Namellama-3.1-70b
Context Window8K tokens
Max Output8K tokens

Capabilities

Vision Function Calling Reasoning JSON Schema System Messages Web Search Prompt Caching Audio Input Audio Output

Pricing

TypePer 1K TokensPer 1M Tokens
Input Tokens$0.000600$0.600
Output Tokens$0.000600$0.600

Price Comparison by Provider

Compare prices for Meta Llama 3.1 70B Instruct across different providers. The same model may be available through multiple providers at different price points.

Provider
Model Key
Input Price
Output Price
Vercel Ai Gatewayvercel_ai_gateway/meta/llama-3.1-70b$0.720$0.720
Perplexityperplexity/llama-3.1-70b-instruct$1.00$1.00
Google Vertex AIvertex_ai/meta/llama-3.1-70b-instruct-maasN/AN/A
Fireworks AIfireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct$0.900$0.900
Cerebrascerebras/llama3.1-70b$0.600$0.600
Snowflakesnowflake/llama3.1-70bN/AN/A
Lambda Ailambda_ai/llama3.1-70b-instruct-fp8$0.120$0.300
Ovhcloudovhcloud/Meta-Llama-3_1-70B-Instruct$0.670$0.670
Azure AIazure_ai/Meta-Llama-3.1-70B-Instruct$2.68$3.54
Deepinfradeepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct$0.400$0.400
Friendliaifriendliai/meta-llama-3.1-70b-instruct$0.600$0.600
Hyperbolichyperbolic/meta-llama/Meta-Llama-3.1-70B-Instruct$0.120$0.300
Together AItogether_ai/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo$0.880$0.880
AWS Bedrockus.meta.llama3-1-70b-instruct-v1:0$0.990$0.990

Similar Models

Models with similar capabilities and context window size.

Model
Provider
Mode
Input Price
Output Price
Context
Max Output
Vision
Functions
Apertus 70B InstructPublicaiTextN/AN/A8K4Knoyes
Apertus 8B InstructPublicaiTextN/AN/A8K4Knoyes
Llama 3 8B Instruct:freeOpenRouterTextN/AN/A8KN/Anono
Llama3OllamaTextN/AN/A8K8Knono
Llama3:70BOllamaTextN/AN/A8K8Knono
Llama3:8BOllamaTextN/AN/A8K8Knono
Llama3.1OllamaTextN/AN/A8K8Knoyes
Mistral 7B Instruct V0.1OllamaTextN/AN/A8K8Knoyes
Mistral 7B Instruct:freeOpenRouterTextN/AN/A8KN/Anono
Sarvam MSarvamTextN/AN/A8K32Knono