ml.inf1.24xlarge
Amazon SageMaker AI instance ml.inf1.24xlarge with 48 vCPUs, 192 GiB RAM. Available in 22 regions starting from $4136.18 per month.
| Instance Type | ml.inf1.24xlarge |
|---|---|
| Instance Family | Accelerated Computing Instances |
| Details | Machine Learning (ML) inference ml – SageMaker ML optimized inf – AWS Inferentia 1 – Generation 24xlarge – Size |
| vCPUs | 48 |
| Memory | 192 GiB |
| CPU Architecture | x86_64 |
| GPU | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Has GPU | no | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Instances | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Sizes | ml.inf1.xlarge, ml.inf1.2xlarge, ml.inf1.6xlarge, ml.inf1.24xlarge | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Generations | ml.inf1.24xlarge, ml.inf2.24xlarge | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| EBS (Elastic Block Store) | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| EBS Optimized | default | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| EBS Baseline IOPS | 80000 IOPS | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| EBS Max IOPS | 80000 IOPS | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| EBS Baseline Bandwidth | 19000 Mbps | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| EBS Max Bandwidth | 19000 Mbps | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Instance Storage | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Instance Storage | no | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Networking | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Max Network Interfaces | 11 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| IPv6 Support | yes | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ENA Support | required | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Regional Availability
US
GovCloud (US-East) / us-gov-east-1
GovCloud (US-West) / us-gov-west-1
US East (Ohio) / us-east-2
US East (Virginia) / us-east-1
US West (N. California) / us-west-1
US West (Oregon) / us-west-2
GovCloud (US-East) / us-gov-east-1
GovCloud (US-West) / us-gov-west-1
US East (Ohio) / us-east-2
US East (Virginia) / us-east-1
US West (N. California) / us-west-1
US West (Oregon) / us-west-2
Central America
Mexico (Central) / mx-central-1
Mexico (Central) / mx-central-1
Canada
Canada (Central) / ca-central-1
Canada West (Calgary) / ca-west-1
Canada (Central) / ca-central-1
Canada West (Calgary) / ca-west-1
Europe
Europe (Ireland) / eu-west-1
Europe (London) / eu-west-2
Europe (Frankfurt) / eu-central-1
Europe (Milan) / eu-south-1
Europe (Paris) / eu-west-3
Europe (Spain) / eu-south-2
Europe (Stockholm) / eu-north-1
Europe (Zurich) / eu-central-2
Europe (Ireland) / eu-west-1
Europe (London) / eu-west-2
Europe (Frankfurt) / eu-central-1
Europe (Milan) / eu-south-1
Europe (Paris) / eu-west-3
Europe (Spain) / eu-south-2
Europe (Stockholm) / eu-north-1
Europe (Zurich) / eu-central-2
Africa
Africa (Cape Town) / af-south-1
Africa (Cape Town) / af-south-1
South America
South America (São Paulo) / sa-east-1
South America (São Paulo) / sa-east-1
Asia Pacific
Asia Pacific (Hong Kong) / ap-east-1
Asia Pacific (Hyderabad) / ap-south-2
Asia Pacific (Jakarta) / ap-southeast-3
Asia Pacific (Malaysia) / ap-southeast-5
Asia Pacific (Melbourne) / ap-southeast-4
Asia Pacific (Mumbai) / ap-south-1
Asia Pacific (New Zealand) / ap-southeast-6
Asia Pacific (Osaka) / ap-northeast-3
Asia Pacific (Seoul) / ap-northeast-2
Asia Pacific (Singapore) / ap-southeast-1
Asia Pacific (Sydney) / ap-southeast-2
Asia Pacific (Taipei) / ap-east-2
Asia Pacific (Thailand) / ap-southeast-7
Asia Pacific (Tokyo) / ap-northeast-1
Asia Pacific (Hong Kong) / ap-east-1
Asia Pacific (Hyderabad) / ap-south-2
Asia Pacific (Jakarta) / ap-southeast-3
Asia Pacific (Malaysia) / ap-southeast-5
Asia Pacific (Melbourne) / ap-southeast-4
Asia Pacific (Mumbai) / ap-south-1
Asia Pacific (New Zealand) / ap-southeast-6
Asia Pacific (Osaka) / ap-northeast-3
Asia Pacific (Seoul) / ap-northeast-2
Asia Pacific (Singapore) / ap-southeast-1
Asia Pacific (Sydney) / ap-southeast-2
Asia Pacific (Taipei) / ap-east-2
Asia Pacific (Thailand) / ap-southeast-7
Asia Pacific (Tokyo) / ap-northeast-1
Middle East
Israel (Tel Aviv) / il-central-1
Middle East (Bahrain) / me-south-1
Middle East (UAE) / me-central-1
Israel (Tel Aviv) / il-central-1
Middle East (Bahrain) / me-south-1
Middle East (UAE) / me-central-1
Regional Prices
Geography | Region | Region | Instance Price |
|---|---|---|---|
| Hidden | Region 13 (hidden-region-13) | hidden-region-13 | 5.6660 |
| Hidden | Region 14 (hidden-region-14) | hidden-region-14 | 5.6660 |
| Hidden | Region 18 (hidden-region-18) | hidden-region-18 | 5.6660 |
| Hidden | Region 1 (hidden-region-1) | hidden-region-1 | 5.9580 |
| Hidden | Region 6 (hidden-region-6) | hidden-region-6 | 6.0200 |
| Hidden | Region 4 (hidden-region-4) | hidden-region-4 | 6.3120 |
| Hidden | Region 8 (hidden-region-8) | hidden-region-8 | 6.3120 |
| Hidden | Region 10 (hidden-region-10) | hidden-region-10 | 6.6200 |
| Hidden | Region 7 (hidden-region-7) | hidden-region-7 | 6.6360 |
| Hidden | Region 9 (hidden-region-9) | hidden-region-9 | 6.6360 |
| Hidden | Region 17 (hidden-region-17) | hidden-region-17 | 6.8050 |
| Hidden | Region 11 (hidden-region-11) | hidden-region-11 | 6.9430 |
| Asia Pacific | Asia Pacific (Seoul) (ap-northeast-2) | ap-northeast-2 | 6.9740 |
| Hidden | Region 3 (hidden-region-3) | hidden-region-3 | 7.0820 |
| Hidden | Region 5 (hidden-region-5) | hidden-region-5 | 7.0820 |
| Hidden | Region 15 (hidden-region-15) | hidden-region-15 | 7.1436 |
| Hidden | Region 16 (hidden-region-16) | hidden-region-16 | 7.1440 |
| Asia Pacific | Asia Pacific (Tokyo) (ap-northeast-1) | ap-northeast-1 | 7.6520 |
| Hidden | Region 2 (hidden-region-2) | hidden-region-2 | 7.6520 |
| Asia Pacific | Asia Pacific (Hong Kong) (ap-east-1) | ap-east-1 | 8.7290 |
| Hidden | Region 12 (hidden-region-12) | hidden-region-12 | 9.3610 |
Similar Alternative Instances
Instance Type | Instance Family | vCPUs | Memory (GiB) | GPU | Instance Price |
|---|---|---|---|---|---|
| ml.m6g.12xlarge | Standard Instances | 48 | 192 | no | 2.2176 |
| ml.m6gd.12xlarge | Standard Instances | 48 | 192 | no | 2.6035 |
| ml.c6i.24xlarge | Compute Optimized Instances | 48 | 192 | no | 4.8960 |
| ml.c7i.24xlarge | Compute Optimized Instances | 48 | 192 | no | 5.1410 |