inf2.8xlarge vs gr6.8xlarge

Instance Typeinf2.8xlargegr6.8xlarge
Instance FamilyMachine Learning ASICGPU instance
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
8xlarge – Size
6 – Generation
8xlarge – Size
vCPUs3232
Memory128 GiB256 GiB
CPU Architecturex86_64x86_64
ProcessorAMD EPYC 7R13 ProcessorAMD EPYC 7R13 Processor
Clock Speed3.6 GHz3.4 GHz
Threads Per Core22
Accelerators
GPUnoyes
GPU NameL4
GPU ManufacturerNVIDIA
GPUs11
GPU Memory22.35 GiB
GPU Total Memory22.35 GiB
Inference Acceleratoryesno
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count1
Accelerator Memory32 GiB24 GiB
FPGAnono
Instances
Sizesinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlargegr6.4xlarge, gr6.8xlarge
SageMakerml.inf2.8xlargeml.gr6.8xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS only2 x 450 GB NVMe SSD
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput10240 MBps16000 MBps
Optimized Baseline Bandwidth10000 Mbps16000 Mbps
Optimized Baseline Throughput1250 Mbps2000 Mbps
Optimized Baseline Performance40000 IOPS64000 IOPS
Optimized Max Performance40000 IOPS64000 IOPS
Optimized Max Bandwidth10000 Mbps16000 Mbps
Optimized Max Throughput1250 Mbps2000 Mbps
Networking
Networking PerformanceUp to 25 Gigabit25 Gigabit
Enhanced Networkingyesyes
Max Interfaces88
Max Cards11
IPv4 Addresses per Interface3030
IPv6 Addresses per Interface3030
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnoyes
EFA Max Interfaces1
Encryption in Transit Supportyesyes
ENA SRD Supportnono
Avg Price Diff1.00x1.17x

Regional Prices

US Dollar ($)
Per Hour
Linux
Shared Tenancy
On Demand
Geography
Region
inf2.8xlarge
gr6.8xlarge
HiddenHidden (hidden-1)2.16472.5777
HiddenHidden (hidden-10)3.34543.1054
HiddenHidden (hidden-11)n/a3.1055
HiddenHidden (hidden-12)n/a3.1807
HiddenHidden (hidden-13)n/a3.4409
HiddenHidden (hidden-14)n/a3.5480
HiddenHidden (hidden-15)n/a4.1585
HiddenHidden (hidden-2)2.45982.5949
HiddenHidden (hidden-3)2.55822.7163
HiddenHidden (hidden-4)2.55822.9377
HiddenHidden (hidden-5)2.75503.0081
HiddenHidden (hidden-6)2.75503.0593
HiddenHidden (hidden-7)2.95183.0815
HiddenHidden (hidden-8)2.95183.0836
HiddenHidden (hidden-9)2.95183.0836
USUS East (Ohio) (us-east-2)1.96792.4464
USUS East (Virginia) (us-east-1)1.96792.4464
USUS West (Oregon) (us-west-2)1.96792.4464
Activate subscription to see all regions and unlock all features

Related Comparisons

Other instances worth weighing against these.