m8id.24xlarge vs inf2.24xlarge

Instance Typem8id.24xlargeinf2.24xlarge
Instance FamilyGeneral purposeMachine Learning ASIC
DetailsSmall to medium size databases, data processing, caching, backends.

mMulti purpose
8 – Generation
i – Intel processor
d – Instance store volume
24xlarge – Size
Machine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
24xlarge – Size
vCPUs9696
Memory384 GiB384 GiB
CPU Architecturex86_64x86_64
ProcessorIntel Xeon Scalable (Granite Rapids)AMD EPYC 7R13 Processor
Clock Speed3.9 GHz3.6 GHz
Threads Per Core22
Accelerators
GPUnono
GPUs6
Inference Acceleratornoyes
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count6
Accelerator Memory192 GiB
FPGAnono
Instances
Sizesm8id.12xlarge, m8id.16xlarge, m8id.24xlarge, m8id.2xlarge, m8id.32xlarge, m8id.48xlarge, m8id.4xlarge, m8id.8xlarge, m8id.96xlarge, m8id.large, m8id.metal-48xl, m8id.metal-96xl, m8id.xlargeinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlarge
Generationsm6id.24xlarge, m8id.24xlargeinf1.24xlarge, inf2.24xlarge
Variantsm8a.24xlarge, m8azn.24xlarge, m8g.24xlarge, m8gb.24xlarge, m8gd.24xlarge, m8gn.24xlarge, m8i.24xlarge
SageMakerml.inf2.24xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance Storage2 x 2850 NVMe SSDEBS only
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput30000 MBps30720 MBps
Optimized Baseline Bandwidth30000 Mbps30000 Mbps
Optimized Baseline Throughput3750 Mbps3750 Mbps
Optimized Baseline Performance120000 IOPS120000 IOPS
Optimized Max Performance120000 IOPS120000 IOPS
Optimized Max Bandwidth30000 Mbps30000 Mbps
Optimized Max Throughput3750 Mbps3750 Mbps
Networking
Networking Performance40000 Megabit50 Gigabit
Enhanced Networkingyesyes
Max Interfaces1615
Max Cards11
IPv4 Addresses per Interface6450
IPv6 Addresses per Interface6450
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnono
Encryption in Transit Supportyesyes
ENA SRD Supportyesno
Avg Price Diff1.00x1.23x

Regional Prices

Geography
Region
m8id.24xlarge
inf2.24xlarge
HiddenHidden (hidden-1)6.98547.1397
HiddenHidden (hidden-10)n/a11.0341
HiddenHidden (hidden-2)7.53988.1133
HiddenHidden (hidden-3)8.09428.4378
HiddenHidden (hidden-4)n/a8.4378
HiddenHidden (hidden-5)n/a9.0869
HiddenHidden (hidden-6)n/a9.0869
HiddenHidden (hidden-7)n/a9.7360
HiddenHidden (hidden-8)n/a9.7360
HiddenHidden (hidden-9)n/a9.7360
USUS East (Ohio) (us-east-2)6.26506.4906
USUS East (Virginia) (us-east-1)6.26506.4906
USUS West (Oregon) (us-west-2)6.26506.4906
Activate subscription to see all regions and unlock awesome features