trn2.48xlarge vs inf2.48xlarge
| trn2.48xlarge | inf2.48xlarge |
| Machine Learning ASIC | Machine Learning ASIC |
| Machine Learning (ML) training trn – AWS Trainium 2 – Generation 48xlarge – Size | Machine Learning (ML) inference inf – AWS Inferentia 2 – Generation 48xlarge – Size |
| 192 | 192 |
| 2048 GiB | 768 GiB |
| x86_64 | x86_64 |
| Intel Xeon Scalable (Sapphire Rapids) | AMD EPYC 7R13 Processor |
| 3.5 GHz | 3.6 GHz |
| 2 | 2 |
| no | no |
| 16 | 12 |
| no | yes |
| Inferentia2 | |
| AWS | |
| 12 | |
| 15363 GiB | 384 GiB |
| no | no |
| trn2.48xlarge | inf2.24xlarge, inf2.48xlarge, inf2.8xlarge, inf2.xlarge |
| ml.trn2.48xlarge | ml.inf2.48xlarge |
| no | no |
| no | no |
| no | no |
| EBS only | EBS only |
| default | default |
| supported | supported |
| required | required |
| 81920 MBps | 61440 MBps |
| 80000 Mbps | 60000 Mbps |
| 10000 Mbps | 7500 Mbps |
| 260000 IOPS | 240000 IOPS |
| 260000 IOPS | 240000 IOPS |
| 80000 Mbps | 60000 Mbps |
| 10000 Mbps | 7500 Mbps |
| 3200 Gigabit | 100 Gigabit |
| yes | yes |
| 32 | 15 |
| 16 | 1 |
| 50 | 50 |
| 50 | 50 |
| yes | yes |
| required | required |
| yes | no |
| 16 | |
| yes | yes |
| no | no |
| Infinityx |
Regional Prices
Geography | Region | trn2.48xlarge | inf2.48xlarge |
|---|---|---|---|
| Hidden | Hidden (hidden-1) | n/a | 14.2794 |
| Hidden | Hidden (hidden-10) | n/a | 22.0682 |
| Hidden | Hidden (hidden-2) | n/a | 16.2266 |
| Hidden | Hidden (hidden-3) | n/a | 16.8757 |
| Hidden | Hidden (hidden-4) | n/a | 16.8757 |
| Hidden | Hidden (hidden-5) | n/a | 18.1738 |
| Hidden | Hidden (hidden-6) | n/a | 18.1738 |
| Hidden | Hidden (hidden-7) | n/a | 19.4719 |
| Hidden | Hidden (hidden-8) | n/a | 19.4719 |
| Hidden | Hidden (hidden-9) | n/a | 19.4719 |
| US | US East (Ohio) (us-east-2) | n/a | 12.9813 |
| US | US East (Virginia) (us-east-1) | n/a | 12.9813 |
| US | US West (Oregon) (us-west-2) | n/a | 12.9813 |