inf2.48xlarge vs r8id.48xlarge

Instance Typeinf2.48xlarger8id.48xlarge
Instance FamilyMachine Learning ASICMemory optimized
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
48xlarge – Size
High-performance databases, data mining/analysis, in-memory databases, distributed large-scale caches, real-time processing apps for unstructured big data, Hadoop/Spark clusters, and other enterprise apps.

rRAM / memory optimized
8 – Generation
i – Intel processor
d – Instance store volume
48xlarge – Size
vCPUs192192
Memory768 GiB1536 GiB
CPU Architecturex86_64x86_64
ProcessorAMD EPYC 7R13 ProcessorIntel Xeon Scalable (Granite Rapids)
Clock Speed3.6 GHz3.9 GHz
Threads Per Core22
Accelerators
GPUnono
GPUs12
Inference Acceleratoryesno
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count12
Accelerator Memory384 GiB
FPGAnono
Instances
Sizesinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlarger8id.12xlarge, r8id.16xlarge, r8id.24xlarge, r8id.2xlarge, r8id.32xlarge, r8id.48xlarge, r8id.4xlarge, r8id.8xlarge, r8id.96xlarge, r8id.large, r8id.metal-48xl, r8id.metal-96xl, r8id.xlarge
Variantsr8a.48xlarge, r8g.48xlarge, r8gb.48xlarge, r8gd.48xlarge, r8gn.48xlarge, r8i.48xlarge
SageMakerml.inf2.48xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS only3 x 3800 NVMe SSD
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput61440 MBps60000 MBps
Optimized Baseline Bandwidth60000 Mbps60000 Mbps
Optimized Baseline Throughput7500 Mbps7500 Mbps
Optimized Baseline Performance240000 IOPS240000 IOPS
Optimized Max Performance240000 IOPS240000 IOPS
Optimized Max Bandwidth60000 Mbps60000 Mbps
Optimized Max Throughput7500 Mbps7500 Mbps
Networking
Networking Performance100 Gigabit75000 Megabit
Enhanced Networkingyesyes
Max Interfaces1524
Max Cards11
IPv4 Addresses per Interface5064
IPv6 Addresses per Interface5064
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnoyes
EFA Max Interfaces1
Encryption in Transit Supportyesyes
ENA SRD Supportnoyes
Avg Price Diff1.00x1.03x

Regional Prices

Geography
Region
inf2.48xlarge
r8id.48xlarge
HiddenHidden (hidden-1)14.279417.7408
HiddenHidden (hidden-10)22.0682n/a
HiddenHidden (hidden-2)16.226619.1827
HiddenHidden (hidden-3)16.875719.2931
HiddenHidden (hidden-4)16.8757n/a
HiddenHidden (hidden-5)18.1738n/a
HiddenHidden (hidden-6)18.1738n/a
HiddenHidden (hidden-7)19.4719n/a
HiddenHidden (hidden-8)19.4719n/a
HiddenHidden (hidden-9)19.4719n/a
USUS East (Ohio) (us-east-2)12.981315.9667
USUS East (Virginia) (us-east-1)12.981315.9667
USUS West (Oregon) (us-west-2)12.981315.9667
Activate subscription to see all regions and unlock awesome features