inf2.48xlarge vs g5.48xlarge

Instance Typeinf2.48xlargeg5.48xlarge
Instance FamilyMachine Learning ASICGPU instance
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
48xlarge – Size
Machine Learning (ML), 3D visualizations, graphics-heavy remote workstations, 3D rendering, application streaming, video encoding, and server-side graphics tasks.

g – GPU (Graphics Processing Unit)
5 – Generation
48xlarge – Size
vCPUs192192
Memory768 GiB768 GiB
CPU Architecturex86_64x86_64
ProcessorAMD EPYC 7R13 ProcessorAMD EPYC 7R32
Clock Speed3.6 GHz3.3 GHz
Threads Per Core22
Accelerators
GPUnoyes
GPU NameA10G
GPU ManufacturerNVIDIA
GPUs128
GPU Memory22.35 GiB
GPU Total Memory178.81 GiB
Inference Acceleratoryesno
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count12
Accelerator Memory384 GiB192 GiB
FPGAnono
Instances
Sizesinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlargeg5.12xlarge, g5.16xlarge, g5.24xlarge, g5.2xlarge, g5.48xlarge, g5.4xlarge, g5.8xlarge, g5.xlarge
Generationsg5.48xlarge, g6.48xlarge, g7.48xlarge
SageMakerml.inf2.48xlargeml.g5.48xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS only2 x 3800 GB NVMe SSD
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput61440 MBps19000 MBps
Optimized Baseline Bandwidth60000 Mbps19000 Mbps
Optimized Baseline Throughput7500 Mbps2375 Mbps
Optimized Baseline Performance240000 IOPS80000 IOPS
Optimized Max Performance240000 IOPS80000 IOPS
Optimized Max Bandwidth60000 Mbps19000 Mbps
Optimized Max Throughput7500 Mbps2375 Mbps
Networking
Networking Performance100 Gigabit100 Gigabit
Enhanced Networkingyesyes
Max Interfaces157
Max Cards11
IPv4 Addresses per Interface5050
IPv6 Addresses per Interface5050
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnoyes
EFA Max Interfaces1
Encryption in Transit Supportyesyes
ENA SRD Supportnono
Avg Price Diff1.00x1.18x

Regional Prices

US Dollar ($)
Per Hour
Linux
Shared Tenancy
On Demand
Geography
Region
inf2.48xlarge
g5.48xlarge
HiddenHidden (hidden-1)14.279417.1623
HiddenHidden (hidden-10)22.068220.6757
HiddenHidden (hidden-11)n/a20.6757
HiddenHidden (hidden-12)n/a21.1776
HiddenHidden (hidden-13)n/a22.7967
HiddenHidden (hidden-14)n/a23.6225
HiddenHidden (hidden-15)n/a25.0764
HiddenHidden (hidden-16)n/a27.6864
HiddenHidden (hidden-2)16.226617.2756
HiddenHidden (hidden-3)16.875718.0852
HiddenHidden (hidden-4)16.875718.1823
HiddenHidden (hidden-5)18.173819.0915
HiddenHidden (hidden-6)18.173819.5586
HiddenHidden (hidden-7)19.471919.9795
HiddenHidden (hidden-8)19.471920.0281
HiddenHidden (hidden-9)19.471920.3681
USUS East (Ohio) (us-east-2)12.981316.2880
USUS East (Virginia) (us-east-1)12.981316.2880
USUS West (Oregon) (us-west-2)12.981316.2880
Activate subscription to see all regions and unlock all features

Related Comparisons

Other instances worth weighing against these.