Select your cookie preferences
We use cookies and similar tools to enhance your experience, provide our services, and make improvements. Approved third parties also use these tools to certain site features. More details available here Cookie Policy

inf2.24xlarge

Holori Button
Data updated at: November 20, 2024 at 12:30 AM UTC

AWS EC2 instance inf2.24xlarge with 96 vCPUs, 384 GiB RAM . Available in 13 regions starting from $4738.16 per month. A -36% cheaper alternative is available.
Instance Typeinf2.24xlarge
Instance FamilyMachine Learning ASIC
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
24xlarge – Size
vCPUs96
Memory384 GiB
CPU Architecturex86_64
ProcessorAMD EPYC 7R13 Processor
Clock Speed3.6 GHz
Threads Per Core2
Accelerators
GPUno
Inference Acceleratoryes
Inference Accelerator NameInferentia
Inference Accelerator ManufacturerAWS
Inference Accelerator Count6
Accelerator Memory192 GiB
FPGAno
Instances
Sizesinf2.xlarge, inf2.8xlarge, inf2.24xlarge, inf2.48xlarge
Generationsinf1.24xlarge, inf2.24xlarge
SageMakerml.inf2.24xlarge
Free Tierno
Burstableno
Hibernationno
Instance StorageEBS only
EBS (Elastic Block Store)
EBS Optimizeddefault
Encryptionsupported
NVMerequired
Dedicated Throughput30720 MBps
Optimized Baseline Bandwidth30000 Mbps
Optimized Baseline Throughput3750 Mbps
Optimized Baseline Performance120000 IOPS
Optimized Max Performance120000 IOPS
Optimized Max Bandwidth30000 Mbps
Optimized Max Throughput3750 Mbps
Networking
Networking Performance50 Gigabit
Enhanced Networkingyes
Max Interfaces15
Max Cards1
IPv4 Addresses per Interface50
IPv6 Addresses per Interface50
IPv6 Supportyes
ENA Supportrequired
EFA Supportno
Encryption in Transit Supportyes
ENA SRD Supportno

Regional Availability

US
GovCloud (US-East) / us-gov-east-1
GovCloud (US-West) / us-gov-west-1
US East (Ohio) / us-east-2
US East (Virginia) / us-east-1
US West (N. California) / us-west-1
US West (Oregon) / us-west-2
Canada
Canada (Central) / ca-central-1
Canada West (Calgary) / ca-west-1
Europe
Europe (Ireland) / eu-west-1
Europe (London) / eu-west-2
Europe (Frankfurt) / eu-central-1
Europe (Milan) / eu-south-1
Europe (Paris) / eu-west-3
Europe (Spain) / eu-south-2
Europe (Stockholm) / eu-north-1
Europe (Zurich) / eu-central-2
Africa
Africa (Cape Town) / af-south-1
South America
South America (São Paulo) / sa-east-1
Asia Pacific
Asia Pacific (Hong Kong) / ap-east-1
Asia Pacific (Hyderabad) / ap-south-2
Asia Pacific (Jakarta) / ap-southeast-3
Asia Pacific (Malaysia) / ap-southeast-5
Asia Pacific (Melbourne) / ap-southeast-4
Asia Pacific (Mumbai) / ap-south-1
Asia Pacific (Osaka) / ap-northeast-3
Asia Pacific (Seoul) / ap-northeast-2
Asia Pacific (Singapore) / ap-southeast-1
Asia Pacific (Sydney) / ap-southeast-2
Asia Pacific (Tokyo) / ap-northeast-1
Middle East
Israel (Tel Aviv) / il-central-1
Middle East (Bahrain) / me-south-1
Middle East (UAE) / me-central-1

Regional Prices

Geography
Region Name
Region
Savings Options
Instance Price
USUS East (Virginia)us-east-1compare6.4906
USUS East (Ohio)us-east-2compare6.4906
USUS West (Oregon)us-west-2compare6.4906
HiddenHiddenhidden-1compare7.1397
HiddenHiddenhidden-2compare8.1133
HiddenHiddenhidden-3compare8.4378
HiddenHiddenhidden-4compare8.4378
HiddenHiddenhidden-5compare9.0869
HiddenHiddenhidden-6compare9.0869
HiddenHiddenhidden-7compare9.7360
HiddenHiddenhidden-8compare9.7360
HiddenHiddenhidden-9compare9.7360
HiddenHiddenhidden-10compare11.0341
Activate subscription to see all regions and unlock awesome features  

Similar Alternative Instances

Instance Type
Region
vCPUs
Memory (GiB)
GPU Name
Instance Price
Price Diff %
m5a.24xlargeUS East (Virginia) (us-east-1)963844.1280-36%
m7i.24xlargeUS East (Virginia) (us-east-1)963844.8384-25%
m5n.24xlargeUS East (Virginia) (us-east-1)963845.7120-12%
inf2.24xlargeUS East (Virginia) (us-east-1)963846.49060%
m5dn.24xlargeUS East (Virginia) (us-east-1)963846.52801%