Select your cookie preferences
We use cookies and similar tools to enhance your experience, provide our services, and make improvements. Approved third parties also use these tools to certain site features. More details available here Cookie Policy

inf2.48xlarge vs p5en.48xlarge

Instance Typeinf2.48xlargep5en.48xlarge
Instance FamilyMachine Learning ASICGPU instance
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
48xlarge – Size
GPU intensive tasks like machine/deep learning, high-performance computing

p – Performance / GPU (Graphics Processing Unit) accelerated
5 – Generation
e – Extra storage or memory
n – Network and EBS optimized
48xlarge – Size
vCPUs192192
Memory768 GiB2048 GiB
CPU Architecturex86_64x86_64
ProcessorAMD EPYC 7R13 ProcessorIntel Xeon Scalable (Sapphire Rapids)
Clock Speed3.6 GHz2.4 GHz
Threads Per Core22
Accelerators
GPUnoyes
GPU NameH200
GPU ManufacturerNVIDIA
GPUs128
GPU Memory141 GiB
GPU Total Memory1128 GiB
Inference Acceleratoryesno
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count12
Accelerator Memory384 GiB1413 GiB
FPGAnono
Instances
Sizesinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlargep5en.48xlarge
Variantsp5.48xlarge, p5e.48xlarge
SageMakerml.inf2.48xlargeml.p5en.48xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS only8 x 3840 NVMe SSD
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput61440 MBps102400 MBps
Optimized Baseline Bandwidth60000 Mbps100000 Mbps
Optimized Baseline Throughput7500 Mbps12500 Mbps
Optimized Baseline Performance240000 IOPS400000 IOPS
Optimized Max Performance240000 IOPS400000 IOPS
Optimized Max Bandwidth60000 Mbps100000 Mbps
Optimized Max Throughput7500 Mbps12500 Mbps
Networking
Networking Performance100 Gigabit3200 Gigabit
Enhanced Networkingyesyes
Max Interfaces1564
Max Cards116
IPv4 Addresses per Interface5050
IPv6 Addresses per Interface5050
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnoyes
EFA Max Interfaces16
Encryption in Transit Supportyesyes
ENA SRD Supportnoyes
Avg Price Diff1.00x4.23x

Regional Prices

Geography
Region
inf2.48xlarge
p5en.48xlarge
Asia PacificAsia Pacific (Jakarta) (ap-southeast-3)n/an/a
Asia PacificAsia Pacific (Mumbai) (ap-south-1)n/an/a
Asia PacificAsia Pacific (Seoul) (ap-northeast-2)n/an/a
HiddenHidden (hidden-1)14.2794n/a
HiddenHidden (hidden-10)22.0682n/a
HiddenHidden (hidden-2)16.2266n/a
HiddenHidden (hidden-3)16.8757n/a
HiddenHidden (hidden-4)16.8757n/a
HiddenHidden (hidden-5)18.1738n/a
HiddenHidden (hidden-6)18.173863.2960
HiddenHidden (hidden-7)19.471967.7267
HiddenHidden (hidden-8)19.471975.9552
HiddenHidden (hidden-9)19.471979.1200
USUS East (Ohio) (us-east-2)12.9813n/a
USUS East (Virginia) (us-east-1)12.9813n/a
USUS West (Oregon) (us-west-2)12.9813n/a
Activate subscription to see all regions and unlock awesome features