Select your cookie preferences
We use cookies and similar tools to enhance your experience, provide our services, and make improvements. Approved third parties also use these tools to certain site features. More details available here Cookie Policy

inf2.24xlarge vs p4de.24xlarge

Instance Typeinf2.24xlargep4de.24xlarge
Instance FamilyMachine Learning ASICGPU instance
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
24xlarge – Size
GPU intensive tasks like machine/deep learning, high-performance computing

p – Performance / GPU (Graphics Processing Unit) accelerated
4 – Generation
d – Instance store volume
e – Extra storage or memory
24xlarge – Size
vCPUs9696
Memory384 GiB1152 GiB
CPU Architecturex86_64x86_64
ProcessorAMD EPYC 7R13 ProcessorIntel Xeon Platinum 8275L
Clock Speed3.6 GHz3 GHz
Threads Per Core22
Accelerators
GPUnoyes
GPU NameA100
GPU ManufacturerNVIDIA
GPUs68
GPU Memory80 GiB
GPU Total Memory640 GiB
Inference Acceleratoryesno
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count6
Accelerator Memory192 GiB6402 GiB
FPGAnono
Instances
Sizesinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlargep4de.24xlarge
Generationsinf1.24xlarge, inf2.24xlarge
Variantsp4d.24xlarge
SageMakerml.inf2.24xlargeml.p4de.24xlarge
Free Tiernono
Burstablenono
Hibernationnono
EC2 Compute Units345
Instance StorageEBS only8 x 1000 SSD
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput30720 MBps19000 MBps
Optimized Baseline Bandwidth30000 Mbps19000 Mbps
Optimized Baseline Throughput3750 Mbps2375 Mbps
Optimized Baseline Performance120000 IOPS80000 IOPS
Optimized Max Performance120000 IOPS80000 IOPS
Optimized Max Bandwidth30000 Mbps19000 Mbps
Optimized Max Throughput3750 Mbps2375 Mbps
Networking
Networking Performance50 Gigabit400 Gigabit
Enhanced Networkingyesno
Max Interfaces1560
Max Cards14
IPv4 Addresses per Interface5050
IPv6 Addresses per Interface5050
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnoyes
EFA Max Interfaces4
Encryption in Transit Supportyesyes
ENA SRD Supportnono
Avg Price Diff1.00x3.85x

Regional Prices

Geography
Region
inf2.24xlarge
p4de.24xlarge
Asia PacificAsia Pacific (Singapore) (ap-southeast-1)n/a32.9365
HiddenHidden (hidden-1)7.139734.2912
HiddenHidden (hidden-10)11.0341n/a
HiddenHidden (hidden-2)8.113335.5735
HiddenHidden (hidden-3)8.437837.6223
HiddenHidden (hidden-4)8.4378n/a
HiddenHidden (hidden-5)9.0869n/a
HiddenHidden (hidden-6)9.0869n/a
HiddenHidden (hidden-7)9.7360n/a
HiddenHidden (hidden-8)9.7360n/a
HiddenHidden (hidden-9)9.7360n/a
USUS East (Ohio) (us-east-2)6.4906n/a
USUS East (Virginia) (us-east-1)6.490627.4471
USUS West (Oregon) (us-west-2)6.490627.4471
Activate subscription to see all regions and unlock awesome features