inf2.8xlarge

Holori Button
Data updated at: November 20, 2024 at 12:30 AM UTC

AWS EC2 instance inf2.8xlarge with 32 vCPUs, 128 GiB RAM . Available in 13 regions starting from $1436.54 per month. A -18% cheaper alternative is available.
Instance Typeinf2.8xlarge
Instance FamilyMachine Learning ASIC
DetailsMachine Learning (ML) inference

inf – AWS Inferentia
2 – Generation
8xlarge – Size
vCPUs32
Memory128 GiB
CPU Architecturex86_64
ProcessorAMD EPYC 7R13 Processor
Clock Speed3.6 GHz
Threads Per Core2
Accelerators
GPUno
Inference Acceleratoryes
Inference Accelerator NameInferentia
Inference Accelerator ManufacturerAWS
Inference Accelerator Count1
Accelerator Memory32 GiB
FPGAno
Instances
Sizesinf2.xlarge, inf2.8xlarge, inf2.24xlarge, inf2.48xlarge
SageMakerml.inf2.8xlarge
Free Tierno
Burstableno
Hibernationno
Instance StorageEBS only
EBS (Elastic Block Store)
EBS Optimizeddefault
Encryptionsupported
NVMerequired
Dedicated Throughput10240 MBps
Optimized Baseline Bandwidth10000 Mbps
Optimized Baseline Throughput1250 Mbps
Optimized Baseline Performance40000 IOPS
Optimized Max Performance40000 IOPS
Optimized Max Bandwidth10000 Mbps
Optimized Max Throughput1250 Mbps
Networking
Networking PerformanceUp to 25 Gigabit
Enhanced Networkingyes
Max Interfaces8
Max Cards1
IPv4 Addresses per Interface30
IPv6 Addresses per Interface30
IPv6 Supportyes
ENA Supportrequired
EFA Supportno
Encryption in Transit Supportyes
ENA SRD Supportno

Regional Availability

US
GovCloud (US-East) / us-gov-east-1
GovCloud (US-West) / us-gov-west-1
US East (Ohio) / us-east-2
US East (Virginia) / us-east-1
US West (N. California) / us-west-1
US West (Oregon) / us-west-2
Canada
Canada (Central) / ca-central-1
Canada West (Calgary) / ca-west-1
Europe
Europe (Ireland) / eu-west-1
Europe (London) / eu-west-2
Europe (Frankfurt) / eu-central-1
Europe (Milan) / eu-south-1
Europe (Paris) / eu-west-3
Europe (Spain) / eu-south-2
Europe (Stockholm) / eu-north-1
Europe (Zurich) / eu-central-2
Africa
Africa (Cape Town) / af-south-1
South America
South America (São Paulo) / sa-east-1
Asia Pacific
Asia Pacific (Hong Kong) / ap-east-1
Asia Pacific (Hyderabad) / ap-south-2
Asia Pacific (Jakarta) / ap-southeast-3
Asia Pacific (Malaysia) / ap-southeast-5
Asia Pacific (Melbourne) / ap-southeast-4
Asia Pacific (Mumbai) / ap-south-1
Asia Pacific (Osaka) / ap-northeast-3
Asia Pacific (Seoul) / ap-northeast-2
Asia Pacific (Singapore) / ap-southeast-1
Asia Pacific (Sydney) / ap-southeast-2
Asia Pacific (Tokyo) / ap-northeast-1
Middle East
Israel (Tel Aviv) / il-central-1
Middle East (Bahrain) / me-south-1
Middle East (UAE) / me-central-1

Regional Prices

Geography
Region Name
Region
Savings Options
Instance Price
USUS East (Virginia)us-east-1compare1.9679
USUS East (Ohio)us-east-2compare1.9679
USUS West (Oregon)us-west-2compare1.9679
HiddenHiddenhidden-1compare2.1647
HiddenHiddenhidden-2compare2.4598
HiddenHiddenhidden-3compare2.5582
HiddenHiddenhidden-4compare2.5582
HiddenHiddenhidden-5compare2.7550
HiddenHiddenhidden-6compare2.7550
HiddenHiddenhidden-7compare2.9518
HiddenHiddenhidden-8compare2.9518
HiddenHiddenhidden-9compare2.9518
HiddenHiddenhidden-10compare3.3454
Activate subscription to see all regions and unlock awesome features  

Similar Alternative Instances

Instance Type
Region
vCPUs
Memory (GiB)
GPU Name
Instance Price
Price Diff %
m7i.8xlargeUS East (Virginia) (us-east-1)321281.6128-18%
m5n.8xlargeUS East (Virginia) (us-east-1)321281.9040-3%
inf2.8xlargeUS East (Virginia) (us-east-1)321281.96790%
m5dn.8xlargeUS East (Virginia) (us-east-1)321282.176011%
d3en.8xlargeUS East (Virginia) (us-east-1)321284.2058114%