GH200 GPU
The GH200 integrates GPU and CPU resources in a single system to improve performance and efficiency for large AI models. It aims to simplify infrastructure by combining processing and memory closer together.
Starting Price
$1.99/hr
Available on 6 cloud providers
Key Specifications
💾Memory
96GB VRAM
🏗️Architecture
Hopper
⚙️Compute Units
N/A
🧮Tensor Cores
528
Technical Specifications
Hardware Details
ManufacturerNVIDIA
ArchitectureHopper
CUDA Cores16896
Tensor Cores528
RT CoresN/A
Compute UnitsN/A
GenerationN/A
Memory & Performance
VRAM96GB
Memory InterfaceN/A
Memory Bandwidth4000 GB/s
FP32 Performance67 TFLOPS
FP16 Performance990 TFLOPS
INT8 Performance1979 TOPS
Performance
Computing Power
CUDA Cores16,896
Tensor Cores528
Computational Performance
FP32 (TFLOPS)67
FP16 (TFLOPS)990
INT8 (TOPS)1,979
Common Use Cases
AI/ML, HPC with large datasets
Market Context
The GH200 sits within NVIDIA’s Hopper architecture lineup, positioned in the ultra performance tier.
Cloud Availability
Available across 6 cloud providers with prices ranging from $1.99/hr. Pricing and availability may vary by region and provider.
Market Position
Released in 2023, this GPU is positioned for professional workloads.
Cheapest GH200 Pricing
The cheapest GH200 is $1.99/hr on Lambda Labs, which is 51% below the average of $4.03/hr across 6 providers.