trn2.48xlarge vs inf1.24xlarge

Instance Typetrn2.48xlargeinf1.24xlarge
Instance FamilyMachine Learning ASICMachine Learning ASIC
DetailsMachine Learning (ML) training

trn – AWS Trainium
2 – Generation
48xlarge – Size
Machine Learning (ML) inference

inf – AWS Inferentia
1 – Generation
24xlarge – Size
vCPUs19296
Memory2048 GiB192 GiB
CPU Architecturex86_64x86_64
ProcessorIntel Xeon Scalable (Sapphire Rapids)Intel Xeon Platinum 8275CL (Cascade Lake)
Clock Speed3.5 GHz2.5 GHz
Threads Per Core22
Accelerators
GPUnono
GPUs1616
Inference Acceleratornoyes
Inference Accelerator NameInferentia
Inference Accelerator ManufacturerAWS
Inference Accelerator Count16
Accelerator Memory15363 GiB
FPGAnono
Instances
Sizestrn2.48xlargeinf1.24xlarge, inf1.2xlarge, inf1.6xlarge, inf1.xlarge
Generationsinf1.24xlarge, inf2.24xlarge
SageMakerml.trn2.48xlargeml.inf1.24xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS onlyEBS only
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput81920 MBps14000 MBps
Optimized Baseline Bandwidth80000 Mbps19000 Mbps
Optimized Baseline Throughput10000 Mbps2375 Mbps
Optimized Baseline Performance260000 IOPS80000 IOPS
Optimized Max Performance260000 IOPS80000 IOPS
Optimized Max Bandwidth80000 Mbps19000 Mbps
Optimized Max Throughput10000 Mbps2375 Mbps
Networking
Networking Performance3200 Gigabit100 Gigabit
Enhanced Networkingyesno
Max Interfaces3211
Max Cards161
IPv4 Addresses per Interface5030
IPv6 Addresses per Interface5030
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportyesyes
EFA Max Interfaces161
Encryption in Transit Supportyesyes
ENA SRD Supportnono
Avg Price DiffInfinityx

Regional Prices

US Dollar ($)
Per Hour
Linux
Shared Tenancy
On Demand
Geography
Region
trn2.48xlarge
inf1.24xlarge
HiddenHidden (hidden-1)n/a4.9650
HiddenHidden (hidden-10)n/a5.8120
HiddenHidden (hidden-11)n/a5.9020
HiddenHidden (hidden-12)n/a5.9020
HiddenHidden (hidden-13)n/a5.9530
HiddenHidden (hidden-14)n/a5.9530
HiddenHidden (hidden-15)n/a6.2490
HiddenHidden (hidden-16)n/a6.3760
HiddenHidden (hidden-17)n/a6.3760
HiddenHidden (hidden-18)n/a7.2740
HiddenHidden (hidden-19)n/a7.8000
HiddenHidden (hidden-2)n/a5.0160
HiddenHidden (hidden-3)n/a5.2600
HiddenHidden (hidden-4)n/a5.2600
HiddenHidden (hidden-5)n/a5.5170
HiddenHidden (hidden-6)n/a5.5300
HiddenHidden (hidden-7)n/a5.5300
HiddenHidden (hidden-8)n/a5.6710
HiddenHidden (hidden-9)n/a5.7860
USUS East (Ohio) (us-east-2)n/a4.7210
USUS East (Virginia) (us-east-1)n/a4.7210
USUS West (Oregon) (us-west-2)n/a4.7210
Activate subscription to see all regions and unlock all features  

Related Comparisons

Other instances worth weighing against these.