inf2.48xlarge vs trn1n.32xlarge

Instance Typeinf2.48xlargetrn1n.32xlarge
Instance FamilyMachine Learning ASICMachine Learning ASIC
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
48xlarge – Size
Machine Learning (ML) training

trn – AWS Trainium
1 – Generation
n – Network and EBS optimized
32xlarge – Size
vCPUs192128
Memory768 GiB512 GiB
CPU Architecturex86_64x86_64
ProcessorAMD EPYC 7R13 ProcessorIntel Xeon Scalable (Icelake)
Clock Speed3.6 GHz3.5 GHz
Threads Per Core22
Accelerators
GPUnono
GPUs1216
Inference Acceleratoryesno
Inference Accelerator NameInferentia2
Inference Accelerator ManufacturerAWS
Inference Accelerator Count12
Accelerator Memory384 GiB512 GiB
FPGAnono
Instances
Sizesinf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlargetrn1n.32xlarge
Variantstrn1.32xlarge
SageMakerml.inf2.48xlargeml.trn1n.32xlarge
Free Tiernono
Burstablenono
Hibernationnono
Instance StorageEBS only4 x 1900 NVMe SSD
EBS (Elastic Block Store)
EBS Optimizeddefaultdefault
Encryptionsupportedsupported
NVMerequiredrequired
Dedicated Throughput61440 MBps81920 MBps
Optimized Baseline Bandwidth60000 Mbps80000 Mbps
Optimized Baseline Throughput7500 Mbps10000 Mbps
Optimized Baseline Performance240000 IOPS260000 IOPS
Optimized Max Performance240000 IOPS260000 IOPS
Optimized Max Bandwidth60000 Mbps80000 Mbps
Optimized Max Throughput7500 Mbps10000 Mbps
Networking
Networking Performance100 Gigabit1600 Gigabit
Enhanced Networkingyesyes
Max Interfaces1580
Max Cards116
IPv4 Addresses per Interface5050
IPv6 Addresses per Interface5050
IPv6 Supportyesyes
ENA Supportrequiredrequired
EFA Supportnoyes
EFA Max Interfaces16
Encryption in Transit Supportyesyes
ENA SRD Supportnono
Avg Price Diff1.00x1.46x

Regional Prices

US Dollar ($)
Per Hour
Linux
Shared Tenancy
On Demand
Geography
Region
inf2.48xlarge
trn1n.32xlarge
HiddenHidden (hidden-1)14.2794n/a
HiddenHidden (hidden-10)22.0682n/a
HiddenHidden (hidden-2)16.2266n/a
HiddenHidden (hidden-3)16.8757n/a
HiddenHidden (hidden-4)16.8757n/a
HiddenHidden (hidden-5)18.1738n/a
HiddenHidden (hidden-6)18.1738n/a
HiddenHidden (hidden-7)19.4719n/a
HiddenHidden (hidden-8)19.4719n/a
HiddenHidden (hidden-9)19.4719n/a
USUS East (Ohio) (us-east-2)12.981324.7800
USUS East (Virginia) (us-east-1)12.981324.7800
USUS West (Oregon) (us-west-2)12.981324.7800
Activate subscription to see all regions and unlock all features  

Related Comparisons

Other instances worth weighing against these.