inf2.48xlarge

Data updated at: October 4, 2024 at 12:27 AM UTC

AWS EC2 instance inf2.48xlarge with 192 vCPUs, 768 GiB RAM . Available in 13 regions starting from $9476.33 per month. A -41% cheaper alternative is available.
Instance Typeinf2.48xlarge
Instance FamilyMachine Learning ASIC
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
48xlarge – Size
vCPUs192
Memory768 GiB
CPU Architecturex86_64
ProcessorAMD EPYC 7R13 Processor
Clock Speed3.6 GHz
Accelerators
GPUno
Inference Acceleratoryes
Inference Accelerator NameInferentia
Inference Accelerator ManufacturerAWS
Inference Accelerator Count12
Accelerator Memory384 GiB
FPGAno
Instances
Sizesinf2.xlarge, inf2.8xlarge, inf2.24xlarge, inf2.48xlarge
SageMakerml.inf2.48xlarge
Free Tierno
Burstableno
Hibernationno
Instance StorageEBS only
EBS (Elastic Block Store)
EBS Optimizeddefault
Encryptionsupported
NVMerequired
Dedicated Throughput61440 MBps
Optimized Baseline Bandwidth60000 Mbps
Optimized Baseline Throughput7500 Mbps
Optimized Baseline Performance240000 IOPS
Optimized Max Performance240000 IOPS
Optimized Max Bandwidth60000 Mbps
Optimized Max Throughput7500 Mbps
Networking
Networking Performance100 Gigabit
Enhanced Networkingyes
Max Interfaces15
Max Cards1
IPv4 Addresses per Interface50
IPv6 Addresses per Interface50
IPv6 Supportyes
ENA Supportrequired
EFA Supportno
Encryption in Transit Supportyes
ENA SRD Supportno

Regional Availability

US
GovCloud (US-East) / us-gov-east-1
GovCloud (US-West) / us-gov-west-1
US East (Ohio) / us-east-2
US East (Virginia) / us-east-1
US West (N. California) / us-west-1
US West (Oregon) / us-west-2
Canada
Canada (Central) / ca-central-1
Canada West (Calgary) / ca-west-1
Europe
Europe (Ireland) / eu-west-1
Europe (London) / eu-west-2
Europe (Frankfurt) / eu-central-1
Europe (Milan) / eu-south-1
Europe (Paris) / eu-west-3
Europe (Spain) / eu-south-2
Europe (Stockholm) / eu-north-1
Europe (Zurich) / eu-central-2
Africa
Africa (Cape Town) / af-south-1
South America
South America (São Paulo) / sa-east-1
Asia Pacific
Asia Pacific (Hong Kong) / ap-east-1
Asia Pacific (Hyderabad) / ap-south-2
Asia Pacific (Jakarta) / ap-southeast-3
Asia Pacific (Malaysia) / ap-southeast-5
Asia Pacific (Melbourne) / ap-southeast-4
Asia Pacific (Mumbai) / ap-south-1
Asia Pacific (Osaka) / ap-northeast-3
Asia Pacific (Seoul) / ap-northeast-2
Asia Pacific (Singapore) / ap-southeast-1
Asia Pacific (Sydney) / ap-southeast-2
Asia Pacific (Tokyo) / ap-northeast-1
Israel
Israel (Tel Aviv) / il-central-1
Middle East
Middle East (Bahrain) / me-south-1
Middle East (UAE) / me-central-1

Regional Prices

Geography
Region Name
Region
Savings Options
Instance Price
USUS East (Virginia)us-east-1compare12.9813
USUS East (Ohio)us-east-2compare12.9813
USUS West (Oregon)us-west-2compare12.9813
HiddenHiddenhidden-1compare14.2794
HiddenHiddenhidden-2compare16.2266
HiddenHiddenhidden-3compare16.8757
HiddenHiddenhidden-4compare16.8757
HiddenHiddenhidden-5compare18.1738
HiddenHiddenhidden-6compare18.1738
HiddenHiddenhidden-7compare19.4719
HiddenHiddenhidden-8compare19.4719
HiddenHiddenhidden-9compare19.4719
HiddenHiddenhidden-10compare22.0682
Activate subscription to see all regions and unlock awesome features  

Similar Alternative Instances

Instance Type
Region
vCPUs
Memory (GiB)
GPU Name
Instance Price
Price Diff %
c8g.48xlargeUS East (Virginia) (us-east-1)1923847.6570-41%
c7i.48xlargeUS East (Virginia) (us-east-1)1923848.5680-34%
m8g.48xlargeUS East (Virginia) (us-east-1)1927688.6170-34%
m7i.48xlargeUS East (Virginia) (us-east-1)1927689.6768-25%
inf2.48xlargeUS East (Virginia) (us-east-1)19276812.98130%