inf1.24xlarge

Amazon Web Services EC2 instance inf1.24xlarge is in the machine learning asic family with 96 vCPUs and 192 GiB of memory. Available in 23 regions.
Instance Typeinf1.24xlarge
Instance FamilyMachine Learning ASIC
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
1 – Generation
24xlarge – Size
vCPUs96
Memory192 GiB
CPU Architecturex86_64
ProcessorIntel Xeon Platinum 8275CL (Cascade Lake)
Clock Speed2.5 GHz
Accelerators
GPUno
Inference Acceleratoryes
Inference Accelerator NameInferentia
Inference Accelerator ManufacturerAWS
Inference Accelerator Count16
FPGAno
Instances
Sizesinf1.xlarge, inf1.2xlarge, inf1.6xlarge, inf1.24xlarge
Generationsinf1.24xlarge, inf2.24xlarge
SageMakerml.inf1.24xlarge
Free Tierno
Burstableno
Hibernationno
Instance StorageEBS only
EBS (Elastic Block Store)
EBS Optimizeddefault
Encryptionsupported
NVMerequired
Dedicated Throughput14000 MBps
Optimized Baseline Bandwidth19000 Mbps
Optimized Baseline Throughput2375 Mbps
Optimized Baseline Performance80000 IOPS
Optimized Max Performance80000 IOPS
Optimized Max Bandwidth19000 Mbps
Optimized Max Throughput2375 Mbps
Networking
Networking Performance100 Gigabit
Enhanced Networkingno
Max Interfaces11
Max Cards1
IPv4 Addresses per Interface30
IPv6 Addresses per Interface30
IPv6 Supportyes
ENA Supportrequired
EFA Supportyes
EFA Max Interfaces1
Encryption in Transit Supportyes
ENA SRD Supportno

Regional Availability

US
GovCloud (US-East) / us-gov-east-1
GovCloud (US-West) / us-gov-west-1
US East (Ohio) / us-east-2
US East (Virginia) / us-east-1
US West (N. California) / us-west-1
US West (Oregon) / us-west-2
Canada
Canada (Central) / ca-central-1
Canada West (Calgary) / ca-west-1
Europe
Europe (Ireland) / eu-west-1
Europe (London) / eu-west-2
Europe (Frankfurt) / eu-central-1
Europe (Milan) / eu-south-1
Europe (Paris) / eu-west-3
Europe (Spain) / eu-south-2
Europe (Stockholm) / eu-north-1
Europe (Zurich) / eu-central-2
Africa
Africa (Cape Town) / af-south-1
South America
South America (São Paulo) / sa-east-1
Asia Pacific
Asia Pacific (Hong Kong) / ap-east-1
Asia Pacific (Hyderabad) / ap-south-2
Asia Pacific (Jakarta) / ap-southeast-3
Asia Pacific (Melbourne) / ap-southeast-4
Asia Pacific (Mumbai) / ap-south-1
Asia Pacific (Osaka) / ap-northeast-3
Asia Pacific (Seoul) / ap-northeast-2
Asia Pacific (Singapore) / ap-southeast-1
Asia Pacific (Sydney) / ap-southeast-2
Asia Pacific (Tokyo) / ap-northeast-1
Israel
Israel (Tel Aviv) / il-central-1
Middle East
Middle East (Bahrain) / me-south-1
Middle East (UAE) / me-central-1

Regional Prices

Geography
Region Name
Region
Savings Options
Instance Price
USUS East (Virginia)us-east-1compare4.7210
USUS East (Ohio)us-east-2compare4.7210
USUS West (Oregon)us-west-2compare4.7210
HiddenHiddenhidden-1compare4.9650
HiddenHiddenhidden-2compare5.0160
HiddenHiddenhidden-3compare5.2600
HiddenHiddenhidden-4compare5.2600
HiddenHiddenhidden-5compare5.5170
HiddenHiddenhidden-6compare5.5300
HiddenHiddenhidden-7compare5.5300
HiddenHiddenhidden-8compare5.6710
HiddenHiddenhidden-9compare5.7860
HiddenHiddenhidden-10compare5.8120
HiddenHiddenhidden-11compare5.9020
HiddenHiddenhidden-12compare5.9020
HiddenHiddenhidden-13compare5.9530
HiddenHiddenhidden-14compare5.9530
HiddenHiddenhidden-15compare6.2490
HiddenHiddenhidden-16compare6.3760
HiddenHiddenhidden-17compare6.3760
HiddenHiddenhidden-18compare7.2740
HiddenHiddenhidden-19compare7.8000
Activate subscription to see all regions and unlock awesome features  

Similar Alternative Instances

Instance Type
Region
vCPUs
Memory (GiB)
GPU Name
Instance Price
Price Diff %
c7i.24xlargeUS East (Virginia) (us-east-1)961924.2840-9%
inf1.24xlargeUS East (Virginia) (us-east-1)961924.72100%
vt1.24xlargeUS East (Virginia) (us-east-1)961925.200010%
m6in.24xlargeUS East (Virginia) (us-east-1)963846.683042%
m6idn.24xlargeUS East (Virginia) (us-east-1)963847.637862%