inf1.24xlarge vs trn2.48xlarge

Instance Typeinf1.24xlargetrn2.48xlarge
Instance FamilyMachine Learning ASICMachine Learning ASIC
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
1 – Generation
24xlarge – Size
Machine Learning (ML) training

trn – AWS Trainium
2 – Generation
48xlarge – Size
vCPUs96192
Memory192 GiB2048 GiB
CPU Architecturex86_64x86_64
ProcessorIntel Xeon Platinum 8275CL (Cascade Lake)Intel Xeon Scalable (Sapphire Rapids)
Clock Speed2.5 GHz3.5 GHz
Threads Per Core22
Accelerators
GPUnono
GPUs1616
Inference Acceleratoryesno
Inference Accelerator NameInferentia
Inference Accelerator ManufacturerAWS
Inference Accelerator Count16
Accelerator Memory15363 GiB
FPGAnono
Instances
Sizesinf1.24xlarge, inf1.2xlarge, inf1.6xlarge, inf1.xlargetrn2.48xlarge
Generationsinf1.24xlarge, inf2.24xlarge
SageMakerml.inf1.24xlargeml.trn2.48xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS onlyEBS only
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput14000 MBps81920 MBps
Optimized Baseline Bandwidth19000 Mbps80000 Mbps
Optimized Baseline Throughput2375 Mbps10000 Mbps
Optimized Baseline Performance80000 IOPS260000 IOPS
Optimized Max Performance80000 IOPS260000 IOPS
Optimized Max Bandwidth19000 Mbps80000 Mbps
Optimized Max Throughput2375 Mbps10000 Mbps
Networking
Networking Performance100 Gigabit3200 Gigabit
Enhanced Networkingnoyes
Max Interfaces1132
Max Cards116
IPv4 Addresses per Interface3050
IPv6 Addresses per Interface3050
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportyesyes
EFA Max Interfaces116
Encryption in Transit Supportyesyes
ENA SRD Supportnono
Avg Price Diff1.00x17.97x

Regional Prices

US Dollar ($)
Per Hour
Linux
Shared Tenancy
On Demand
Geography
Region
inf1.24xlarge
trn2.48xlarge
Asia PacificAsia Pacific (Hyderabad) (ap-south-2)n/a103.1570
HiddenHidden (hidden-1)4.9650n/a
HiddenHidden (hidden-10)5.8120n/a
HiddenHidden (hidden-11)5.9020n/a
HiddenHidden (hidden-12)5.9020n/a
HiddenHidden (hidden-13)5.9530n/a
HiddenHidden (hidden-14)5.9530n/a
HiddenHidden (hidden-15)6.2490n/a
HiddenHidden (hidden-16)6.3760n/a
HiddenHidden (hidden-17)6.3760n/a
HiddenHidden (hidden-18)7.2740n/a
HiddenHidden (hidden-19)7.8000n/a
HiddenHidden (hidden-2)5.0160n/a
HiddenHidden (hidden-3)5.2600n/a
HiddenHidden (hidden-4)5.2600n/a
HiddenHidden (hidden-5)5.5170n/a
HiddenHidden (hidden-6)5.5300n/a
HiddenHidden (hidden-7)5.5300n/a
HiddenHidden (hidden-8)5.6710n/a
HiddenHidden (hidden-9)5.7860n/a
USUS East (Ohio) (us-east-2)4.7210n/a
USUS East (Virginia) (us-east-1)4.7210n/a
USUS West (Oregon) (us-west-2)4.7210n/a
Activate subscription to see all regions and unlock all features

Related Comparisons

Other instances worth weighing against these.