inf2.24xlarge vs r8in.24xlarge

Instance Typeinf2.24xlarger8in.24xlarge
Instance FamilyMachine Learning ASICMemory optimized
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
24xlarge – Size
High-performance databases, data mining/analysis, in-memory databases, distributed large-scale caches, real-time processing apps for unstructured big data, Hadoop/Spark clusters, and other enterprise apps.

rRAM / memory optimized
8 – Generation
i – Intel processor
n – Network and EBS optimized
24xlarge – Size
vCPUs9696
Memory384 GiB768 GiB
CPU Architecturex86_64x86_64
ProcessorAMD EPYC 7R13 ProcessorIntel Xeon Scalable (Granite Rapids)
Clock Speed3.6 GHz3.9 GHz
Threads Per Core22
Accelerators
GPUnono
GPUs6
Inference Acceleratoryesno
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count6
Accelerator Memory192 GiB
FPGAnono
Instances
Sizesinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlarger8in.12xlarge, r8in.16xlarge, r8in.24xlarge, r8in.2xlarge, r8in.32xlarge, r8in.48xlarge, r8in.4xlarge, r8in.8xlarge, r8in.96xlarge, r8in.large, r8in.xlarge
Generationsinf1.24xlarge, inf2.24xlarger6in.24xlarge, r8in.24xlarge
Variantsr8a.24xlarge, r8g.24xlarge, r8gb.24xlarge, r8gd.24xlarge, r8gn.24xlarge, r8i.24xlarge, r8ib.24xlarge, r8id.24xlarge
SageMakerml.inf2.24xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS onlyEBS only
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput30720 MBps30000 MBps
Optimized Baseline Bandwidth30000 Mbps30000 Mbps
Optimized Baseline Throughput3750 Mbps3750 Mbps
Optimized Baseline Performance120000 IOPS120000 IOPS
Optimized Max Performance120000 IOPS120000 IOPS
Optimized Max Bandwidth30000 Mbps30000 Mbps
Optimized Max Throughput3750 Mbps3750 Mbps
Networking
Networking Performance50 Gigabit150 Gigabit
Enhanced Networkingyesyes
Max Interfaces1516
Max Cards11
IPv4 Addresses per Interface5064
IPv6 Addresses per Interface5064
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnono
Encryption in Transit Supportyesyes
ENA SRD Supportnoyes
Avg Price Diff1.00x1.22x

Regional Prices

Geography
Region
inf2.24xlarge
r8in.24xlarge
HiddenHidden (hidden-1)7.139711.2546
HiddenHidden (hidden-10)11.0341n/a
HiddenHidden (hidden-2)8.1133n/a
HiddenHidden (hidden-3)8.4378n/a
HiddenHidden (hidden-4)8.4378n/a
HiddenHidden (hidden-5)9.0869n/a
HiddenHidden (hidden-6)9.0869n/a
HiddenHidden (hidden-7)9.7360n/a
HiddenHidden (hidden-8)9.7360n/a
HiddenHidden (hidden-9)9.7360n/a
USUS East (Ohio) (us-east-2)6.490610.0416
USUS East (Virginia) (us-east-1)6.490610.0416
USUS West (Oregon) (us-west-2)6.490610.0416
Activate subscription to see all regions and unlock awesome features