Select your cookie preferences
We use cookies and similar tools to enhance your experience, provide our services, and make improvements. Approved third parties also use these tools to certain site features. More details available here Cookie Policy

inf2.24xlarge vs g7e.24xlarge

Instance Typeinf2.24xlargeg7e.24xlarge
Instance FamilyMachine Learning ASICGPU instance
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
24xlarge – Size
Machine Learning (ML), 3D visualizations, graphics-heavy remote workstations, 3D rendering, application streaming, video encoding, and server-side graphics tasks.

g – GPU (Graphics Processing Unit)
7 – Generation
e – Extra storage or memory
24xlarge – Size
vCPUs9696
Memory384 GiB1024 GiB
CPU Architecturex86_64x86_64
ProcessorAMD EPYC 7R13 ProcessorIntel Xeon Scalable (Emerald Rapids)
Clock Speed3.6 GHz2.4 GHz
Threads Per Core22
Accelerators
GPUnoyes
GPU NameRTX PRO Server 6000
GPU ManufacturerNVIDIA
GPUs64
GPU Memory96 GiB
GPU Total Memory384 GiB
Inference Acceleratoryesno
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count6
Accelerator Memory192 GiB384 GiB
FPGAnono
Instances
Sizesinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlargeg7e.12xlarge, g7e.24xlarge, g7e.2xlarge, g7e.48xlarge, g7e.4xlarge, g7e.8xlarge
Generationsinf1.24xlarge, inf2.24xlargeg6e.24xlarge, g7e.24xlarge
SageMakerml.inf2.24xlargeml.g7e.24xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS only2 x 3800 NVMe SSD
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput30720 MBps50000 MBps
Optimized Baseline Bandwidth30000 Mbps50000 Mbps
Optimized Baseline Throughput3750 Mbps6250 Mbps
Optimized Baseline Performance120000 IOPS200000 IOPS
Optimized Max Performance120000 IOPS200000 IOPS
Optimized Max Bandwidth30000 Mbps50000 Mbps
Optimized Max Throughput3750 Mbps6250 Mbps
Networking
Networking Performance50 Gigabit800 Gigabit
Enhanced Networkingyesyes
Max Interfaces1520
Max Cards12
IPv4 Addresses per Interface5064
IPv6 Addresses per Interface5064
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnoyes
EFA Max Interfaces2
Encryption in Transit Supportyesyes
ENA SRD Supportnoyes
Avg Price Diff1.00x2.18x

Regional Prices

Geography
Region
inf2.24xlarge
g7e.24xlarge
HiddenHidden (hidden-1)7.139724.0345
HiddenHidden (hidden-10)11.0341n/a
HiddenHidden (hidden-2)8.1133n/a
HiddenHidden (hidden-3)8.4378n/a
HiddenHidden (hidden-4)8.4378n/a
HiddenHidden (hidden-5)9.0869n/a
HiddenHidden (hidden-6)9.0869n/a
HiddenHidden (hidden-7)9.7360n/a
HiddenHidden (hidden-8)9.7360n/a
HiddenHidden (hidden-9)9.7360n/a
USUS East (Ohio) (us-east-2)6.490616.5722
USUS East (Virginia) (us-east-1)6.490616.5722
USUS West (Oregon) (us-west-2)6.490616.5722
Activate subscription to see all regions and unlock awesome features