inf2.8xlarge vs g7e.8xlarge

Instance Typeinf2.8xlargeg7e.8xlarge
Instance FamilyMachine Learning ASICGPU instance
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
8xlarge – Size
Machine Learning (ML), 3D visualizations, graphics-heavy remote workstations, 3D rendering, application streaming, video encoding, and server-side graphics tasks.

g – GPU (Graphics Processing Unit)
7 – Generation
e – Extra storage or memory
8xlarge – Size
vCPUs3232
Memory128 GiB256 GiB
CPU Architecturex86_64x86_64
ProcessorAMD EPYC 7R13 ProcessorIntel Xeon Scalable (Emerald Rapids)
Clock Speed3.6 GHz2.4 GHz
Threads Per Core22
Accelerators
GPUnoyes
GPU NameRTX PRO Server 6000
GPU ManufacturerNVIDIA
GPUs11
GPU Memory96 GiB
GPU Total Memory96 GiB
Inference Acceleratoryesno
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count1
Accelerator Memory32 GiB96 GiB
FPGAnono
Instances
Sizesinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlargeg7e.12xlarge, g7e.24xlarge, g7e.2xlarge, g7e.48xlarge, g7e.4xlarge, g7e.8xlarge
Generationsg6e.8xlarge, g7e.8xlarge
Variantsg7.8xlarge
SageMakerml.inf2.8xlargeml.g7e.8xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS only1 x 1900 NVMe SSD
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput10240 MBps16000 MBps
Optimized Baseline Bandwidth10000 Mbps16000 Mbps
Optimized Baseline Throughput1250 Mbps2000 Mbps
Optimized Baseline Performance40000 IOPS64000 IOPS
Optimized Max Performance40000 IOPS64000 IOPS
Optimized Max Bandwidth10000 Mbps16000 Mbps
Optimized Max Throughput1250 Mbps2000 Mbps
Networking
Networking PerformanceUp to 25 Gigabit100 Gigabit
Enhanced Networkingyesyes
Max Interfaces88
Max Cards11
IPv4 Addresses per Interface3064
IPv6 Addresses per Interface3064
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnoyes
EFA Max Interfaces1
Encryption in Transit Supportyesyes
ENA SRD Supportnono
Avg Price Diff1.00x2.72x

Regional Prices

US Dollar ($)
Per Hour
Linux
Shared Tenancy
On Demand
Geography
Region
inf2.8xlarge
g7e.8xlarge
HiddenHidden (hidden-1)2.16475.5513
HiddenHidden (hidden-10)3.3454n/a
HiddenHidden (hidden-2)2.45986.4770
HiddenHidden (hidden-3)2.55827.5999
HiddenHidden (hidden-4)2.55827.6405
HiddenHidden (hidden-5)2.75508.6047
HiddenHidden (hidden-6)2.75508.9589
HiddenHidden (hidden-7)2.95189.1565
HiddenHidden (hidden-8)2.9518n/a
HiddenHidden (hidden-9)2.9518n/a
USUS East (Ohio) (us-east-2)1.96795.2682
USUS East (Virginia) (us-east-1)1.96795.2682
USUS West (Oregon) (us-west-2)1.96795.2682
Activate subscription to see all regions and unlock all features

Related Comparisons

Other instances worth weighing against these.