Select your cookie preferences
We use cookies and similar tools to enhance your experience, provide our services, and make improvements. Approved third parties also use these tools to certain site features. More details available here Cookie Policy

inf1.24xlarge vs inf2.24xlarge

Instance Typeinf1.24xlargeinf2.24xlarge
Instance FamilyMachine Learning ASICMachine Learning ASIC
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
1 – Generation
24xlarge – Size
Machine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
24xlarge – Size
vCPUs9696
Memory192 GiB384 GiB
CPU Architecturex86_64x86_64
ProcessorIntel Xeon Platinum 8275CL (Cascade Lake)AMD EPYC 7R13 Processor
Clock Speed2.5 GHz3.6 GHz
Threads Per Core22
Accelerators
GPUnono
GPUs166
Inference Acceleratoryesyes
Inference Accelerator NameInferentiaInferentia2
Inference Accelerator ManufacturerAWSAWS
Inference Accelerator Count166
Accelerator Memory192 GiB
FPGAnono
Instances
Sizesinf1.24xlarge, inf1.2xlarge, inf1.6xlarge, inf1.xlargeinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlarge
Generationsinf1.24xlarge, inf2.24xlargeinf1.24xlarge, inf2.24xlarge
SageMakerml.inf1.24xlargeml.inf2.24xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS onlyEBS only
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput14000 MBps30720 MBps
Optimized Baseline Bandwidth19000 Mbps30000 Mbps
Optimized Baseline Throughput2375 Mbps3750 Mbps
Optimized Baseline Performance80000 IOPS120000 IOPS
Optimized Max Performance80000 IOPS120000 IOPS
Optimized Max Bandwidth19000 Mbps30000 Mbps
Optimized Max Throughput2375 Mbps3750 Mbps
Networking
Networking Performance100 Gigabit50 Gigabit
Enhanced Networkingnoyes
Max Interfaces1115
Max Cards11
IPv4 Addresses per Interface3050
IPv6 Addresses per Interface3050
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportyesno
EFA Max Interfaces1
Encryption in Transit Supportyesyes
ENA SRD Supportnono
Avg Price Diff1.00x1.47x

Regional Prices

Geography
Region
inf1.24xlarge
inf2.24xlarge
HiddenHidden (hidden-1)4.96507.1397
HiddenHidden (hidden-10)5.812011.0341
HiddenHidden (hidden-11)5.9020n/a
HiddenHidden (hidden-12)5.9020n/a
HiddenHidden (hidden-13)5.9530n/a
HiddenHidden (hidden-14)5.9530n/a
HiddenHidden (hidden-15)6.2490n/a
HiddenHidden (hidden-16)6.3760n/a
HiddenHidden (hidden-17)6.3760n/a
HiddenHidden (hidden-18)7.2740n/a
HiddenHidden (hidden-19)7.8000n/a
HiddenHidden (hidden-2)5.01608.1133
HiddenHidden (hidden-3)5.26008.4378
HiddenHidden (hidden-4)5.26008.4378
HiddenHidden (hidden-5)5.51709.0869
HiddenHidden (hidden-6)5.53009.0869
HiddenHidden (hidden-7)5.53009.7360
HiddenHidden (hidden-8)5.67109.7360
HiddenHidden (hidden-9)5.78609.7360
USUS East (Ohio) (us-east-2)4.72106.4906
USUS East (Virginia) (us-east-1)4.72106.4906
USUS West (Oregon) (us-west-2)4.72106.4906
Activate subscription to see all regions and unlock awesome features