inf2.24xlarge vs g5.24xlarge

Instance Typeinf2.24xlargeg5.24xlarge
Instance FamilyMachine Learning ASICGPU instance
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
24xlarge – Size
Machine Learning (ML), 3D visualizations, graphics-heavy remote workstations, 3D rendering, application streaming, video encoding, and server-side graphics tasks.

g – GPU (Graphics Processing Unit)
5 – Generation
24xlarge – Size
vCPUs9696
Memory384 GiB384 GiB
CPU Architecturex86_64x86_64
ProcessorAMD EPYC 7R13 ProcessorAMD EPYC 7R32
Clock Speed3.6 GHz3.3 GHz
Threads Per Core22
Accelerators
GPUnoyes
GPU NameA10G
GPU ManufacturerNVIDIA
GPUs64
GPU Memory22.35 GiB
GPU Total Memory89.41 GiB
Inference Acceleratoryesno
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count6
Accelerator Memory192 GiB96 GiB
FPGAnono
Instances
Sizesinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlargeg5.12xlarge, g5.16xlarge, g5.24xlarge, g5.2xlarge, g5.48xlarge, g5.4xlarge, g5.8xlarge, g5.xlarge
Generationsinf1.24xlarge, inf2.24xlargeg5.24xlarge, g6.24xlarge, g7.24xlarge
SageMakerml.inf2.24xlargeml.g5.24xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS only1 x 3800 GB NVMe SSD
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput30720 MBps19000 MBps
Optimized Baseline Bandwidth30000 Mbps19000 Mbps
Optimized Baseline Throughput3750 Mbps2375 Mbps
Optimized Baseline Performance120000 IOPS80000 IOPS
Optimized Max Performance120000 IOPS80000 IOPS
Optimized Max Bandwidth30000 Mbps19000 Mbps
Optimized Max Throughput3750 Mbps2375 Mbps
Networking
Networking Performance50 Gigabit50 Gigabit
Enhanced Networkingyesyes
Max Interfaces1515
Max Cards11
IPv4 Addresses per Interface5050
IPv6 Addresses per Interface5050
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnoyes
EFA Max Interfaces1
Encryption in Transit Supportyesyes
ENA SRD Supportnono
Avg Price Diff1.00x1.18x

Regional Prices

US Dollar ($)
Per Hour
Linux
Shared Tenancy
On Demand
Geography
Region
inf2.24xlarge
g5.24xlarge
HiddenHidden (hidden-1)7.13978.5812
HiddenHidden (hidden-10)11.034110.3379
HiddenHidden (hidden-11)n/a10.3379
HiddenHidden (hidden-12)n/a10.5888
HiddenHidden (hidden-13)n/a11.3984
HiddenHidden (hidden-14)n/a11.8112
HiddenHidden (hidden-15)n/a12.5382
HiddenHidden (hidden-16)n/a13.8432
HiddenHidden (hidden-2)8.11338.6378
HiddenHidden (hidden-3)8.43789.0426
HiddenHidden (hidden-4)8.43789.0912
HiddenHidden (hidden-5)9.08699.5457
HiddenHidden (hidden-6)9.08699.7793
HiddenHidden (hidden-7)9.73609.9898
HiddenHidden (hidden-8)9.736010.0140
HiddenHidden (hidden-9)9.736010.1841
USUS East (Ohio) (us-east-2)6.49068.1440
USUS East (Virginia) (us-east-1)6.49068.1440
USUS West (Oregon) (us-west-2)6.49068.1440
Activate subscription to see all regions and unlock all features  

Related Comparisons

Other instances worth weighing against these.