g5.24xlarge


Amazon EC2 instance g5.24xlarge with 96 vCPUs, 384 GiB RAM and 4 x NVIDIA A10G 22.35 GiB. Available in 17 regions starting from $5945.12 per month. A -20% cheaper alternative is available.
Instance Typeg5.24xlarge
Instance FamilyGPU instance
DetailsMachine Learning (ML), 3D visualizations, graphics-heavy remote workstations, 3D rendering, application streaming, video encoding, and server-side graphics tasks.

g – GPU (Graphics Processing Unit)
5 – Generation
24xlarge – Size
vCPUs96
Memory384 GiB
CPU Architecturex86_64
ProcessorAMD EPYC 7R32
Clock Speed3.3 GHz
Threads Per Core2
Accelerators
GPUyes
GPU NameA10G
GPU ManufacturerNVIDIA
GPUs4
GPU Memory22.35 GiB
GPU Total Memory89.41 GiB
Inference Acceleratorno
Accelerator Memory96 GiB
FPGAno
Instances
Sizesg5.xlarge, g5.2xlarge, g5.4xlarge, g5.8xlarge, g5.12xlarge, g5.16xlarge, g5.24xlarge, g5.48xlarge
Generationsg5.24xlarge, g6.24xlarge
SageMakerml.g5.24xlarge
Free Tierno
Burstableno
Hibernationno
Instance Storage1 x 3800 GB NVMe SSD
EBS (Elastic Block Store)
EBS Optimizeddefault
Encryptionsupported
NVMerequired
Dedicated Throughput19000 MBps
Optimized Baseline Bandwidth19000 Mbps
Optimized Baseline Throughput2375 Mbps
Optimized Baseline Performance80000 IOPS
Optimized Max Performance80000 IOPS
Optimized Max Bandwidth19000 Mbps
Optimized Max Throughput2375 Mbps
Networking
Networking Performance50 Gigabit
Enhanced Networkingyes
Max Interfaces15
Max Cards1
IPv4 Addresses per Interface50
IPv6 Addresses per Interface50
IPv6 Supportyes
ENA Supportrequired
EFA Supportyes
EFA Max Interfaces1
Encryption in Transit Supportyes
ENA SRD Supportno

Regional Availability

US
GovCloud (US-East) / us-gov-east-1
GovCloud (US-West) / us-gov-west-1
US East (Ohio) / us-east-2
US East (Virginia) / us-east-1
US West (N. California) / us-west-1
US West (Oregon) / us-west-2
Central America
Mexico (Central) / mx-central-1
Canada
Canada (Central) / ca-central-1
Canada West (Calgary) / ca-west-1
Europe
Europe (Ireland) / eu-west-1
Europe (London) / eu-west-2
Europe (Frankfurt) / eu-central-1
Europe (Milan) / eu-south-1
Europe (Paris) / eu-west-3
Europe (Spain) / eu-south-2
Europe (Stockholm) / eu-north-1
Europe (Zurich) / eu-central-2
Africa
Africa (Cape Town) / af-south-1
South America
South America (São Paulo) / sa-east-1
Asia Pacific
Asia Pacific (Hong Kong) / ap-east-1
Asia Pacific (Hyderabad) / ap-south-2
Asia Pacific (Jakarta) / ap-southeast-3
Asia Pacific (Malaysia) / ap-southeast-5
Asia Pacific (Melbourne) / ap-southeast-4
Asia Pacific (Mumbai) / ap-south-1
Asia Pacific (New Zealand) / ap-southeast-6
Asia Pacific (Osaka) / ap-northeast-3
Asia Pacific (Seoul) / ap-northeast-2
Asia Pacific (Singapore) / ap-southeast-1
Asia Pacific (Sydney) / ap-southeast-2
Asia Pacific (Taipei) / ap-east-2
Asia Pacific (Thailand) / ap-southeast-7
Asia Pacific (Tokyo) / ap-northeast-1
Middle East
Israel (Tel Aviv) / il-central-1
Middle East (Bahrain) / me-south-1
Middle East (UAE) / me-central-1

Regional Prices

US Dollar ($)
Per Hour
Linux
Shared Tenancy
On Demand
Geography
Region Name
Region
Savings Options
Instance Price
USUS East (Virginia)us-east-1compare8.1440
USUS East (Ohio)us-east-2compare8.1440
USUS West (Oregon)us-west-2compare8.1440
HiddenHiddenhidden-1compare8.6378
HiddenHiddenhidden-2compare9.0426
HiddenHiddenhidden-3compare9.0912
HiddenHiddenhidden-4compare9.5457
HiddenHiddenhidden-5compare9.7793
HiddenHiddenhidden-6compare9.9898
HiddenHiddenhidden-7compare10.0140
HiddenHiddenhidden-8compare10.1841
HiddenHiddenhidden-9compare10.3379
HiddenHiddenhidden-10compare10.5888
HiddenHiddenhidden-11compare11.3984
HiddenHiddenhidden-12compare11.8112
HiddenHiddenhidden-13compare12.5382
HiddenHiddenhidden-14compare13.8432
Activate subscription to see all regions and unlock awesome features  

Best AI models you can run on this instance

Top open-weight chat models ranked by Intelligence Index that fit in g5.24xlarge's 89 GB of GPU memory, assuming the model is sharded across all 4 GPUs. VRAM is estimated from the parameter count at the selected quantization, so treat it as guidance rather than a guarantee.

Chat Models
FP16 (full precision)
Model
Creator
Intelligence
Total params
Active params
~VRAM
Qwen3.6 27BAlibaba logoAlibaba45.8#5127B—65 GB
Qwen3.6 35B A3BAlibaba logoAlibaba43.5#6135B3B84 GB
Qwen3.5 27BAlibaba logoAlibaba42.1#7127B—65 GB
7 more models fit on g5.24xlarge
Unlock the full ranked list and FP8 / INT4 quantization with a CloudPrice subscription.

Similar Alternative Instances

Find Similar Instances In:
Instance Type
Region
vCPUs
Memory (GiB)
GPU Name
Instance Price
Price Diff %
inf2.24xlargeUS East (Virginia) (us-east-1)963846.4906-20%
g6.24xlargeUS East (Virginia) (us-east-1)96384L46.6752-18%
dl1.24xlargeUS East (Virginia) (us-east-1)96768Gaudi HL-20513.109061%
g6e.24xlargeUS East (Virginia) (us-east-1)96768L40S15.065685%
p3dn.24xlargeUS East (Virginia) (us-east-1)96768V10031.2120283%
Select your cookie preferences
We use cookies and similar tools to enhance your experience, provide our services, and make improvements. Approved third parties also use these tools to certain site features. More details available here Cookie Policy