inf2.8xlarge vs r9gd.8xlarge

Instance Typeinf2.8xlarger9gd.8xlarge
Instance FamilyMachine Learning ASICMemory optimized
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
8xlarge – Size
High-performance databases, data mining/analysis, in-memory databases, distributed large-scale caches, real-time processing apps for unstructured big data, Hadoop/Spark clusters, and other enterprise apps.

r – RAM / memory optimized
9 – Generation
g – AWS Graviton processor
d – Instance store volume
8xlarge – Size
vCPUs3232
Memory128 GiB256 GiB
CPU Architecturex86_64arm64
ProcessorAMD EPYC 7R13 ProcessorAWS Graviton5 Processor
Clock Speed3.6 GHz3.3 GHz
Threads Per Core21
Accelerators
GPUnono
GPUs1
Inference Acceleratoryesno
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count1
Accelerator Memory32 GiB
FPGAnono
Instances
Sizesinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlarger9gd.12xlarge, r9gd.16xlarge, r9gd.24xlarge, r9gd.2xlarge, r9gd.48xlarge, r9gd.4xlarge, r9gd.8xlarge, r9gd.large, r9gd.medium, r9gd.metal-48xl, r9gd.xlarge
Generationsr6gd.8xlarge, r7gd.8xlarge, r8gd.8xlarge, r9gd.8xlarge
Variantsr9g.8xlarge
SageMakerml.inf2.8xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS only1 x 1900 NVMe SSD
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput10240 MBps12000 MBps
Optimized Baseline Bandwidth10000 Mbps12000 Mbps
Optimized Baseline Throughput1250 Mbps1500 Mbps
Optimized Baseline Performance40000 IOPS48000 IOPS
Optimized Max Performance40000 IOPS48000 IOPS
Optimized Max Bandwidth10000 Mbps12000 Mbps
Optimized Max Throughput1250 Mbps1500 Mbps
Networking
Networking PerformanceUp to 25 Gigabit17 Gigabit
Enhanced Networkingyesyes
Max Interfaces810
Max Cards11
IPv4 Addresses per Interface3050
IPv6 Addresses per Interface3050
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnono
Encryption in Transit Supportyesyes
ENA SRD Supportnoyes
Avg Price Diff1.00x1.05x

Regional Prices

US Dollar ($)
Per Hour
Linux
Shared Tenancy
On Demand
Geography
Region
inf2.8xlarge
r9gd.8xlarge
HiddenHidden (hidden-1)2.16473.0794
HiddenHidden (hidden-10)3.3454n/a
HiddenHidden (hidden-2)2.4598n/a
HiddenHidden (hidden-3)2.5582n/a
HiddenHidden (hidden-4)2.5582n/a
HiddenHidden (hidden-5)2.7550n/a
HiddenHidden (hidden-6)2.7550n/a
HiddenHidden (hidden-7)2.9518n/a
HiddenHidden (hidden-8)2.9518n/a
HiddenHidden (hidden-9)2.9518n/a
USUS East (Ohio) (us-east-2)1.96792.5629
USUS East (Virginia) (us-east-1)1.96792.5629
USUS West (Oregon) (us-west-2)1.96792.5629
Activate subscription to see all regions and unlock all features

Related Comparisons

Other instances worth weighing against these.