H200 GPU

The H200 is designed for large-scale AI training and inference, offering improved precision and throughput for transformer models. It handles complex AI workloads with better energy efficiency than previous generations.

Starting Price
$0.62/hr
Available on 38 cloud providers
H200 GPU

Key Specifications

💾Memory

141GB VRAM

🏗️Architecture

Hopper

⚙️Compute Units

N/A

🧮Tensor Cores

528

Technical Specifications

Hardware Details

ManufacturerNVIDIA
ArchitectureHopper
CUDA Cores16896
Tensor Cores528
RT CoresN/A
Compute UnitsN/A
GenerationN/A

Memory & Performance

VRAM141GB
Memory InterfaceN/A
Memory Bandwidth4800 GB/s
FP32 Performance67 TFLOPS
FP16 Performance990 TFLOPS
INT8 Performance1979 TOPS

Performance

Computing Power

CUDA Cores16,896
Tensor Cores528

Computational Performance

FP32 (TFLOPS)67
FP16 (TFLOPS)990
INT8 (TOPS)1,979

Common Use Cases

Generative AI and large language models (LLMs) training. Advanced scientific computing for HPC workloads.

Market Context

The H200 sits within NVIDIA’s Hopper architecture lineup, positioned in the ultra performance tier.

Cloud Availability

Available across 38 cloud providers with prices ranging from $0.62/hr. Pricing and availability may vary by region and provider.

Market Position

Released in 2023, this GPU is positioned for professional workloads.

Cheapest H200 Pricing

The cheapest H200 is $0.62/hr on Amazon AWS, which is 90% below the average of $5.95/hr across 38 providers.

Current Pricing

ProviderHourly PriceSource
Deep Infra
$1.99/hr
Nebius
$3.65/hr
Nebius
$3.56/hr
CoreWeave
$50.44/hr
CoreWeave
$6.31/hr
CoreWeave
$50.44/hr
RunPod
$3.59/hr
RunPod
$3.59/hr
Amazon AWS
$0.62/hr
Vast.ai
$1.97/hr
Vast.ai
$3.06/hr
Hyperstack
$3.50/hr
Hyperstack
$3.50/hr
Hyperstack
$2.45/hr
DigitalOcean
$3.44/hr
DigitalOcean
$3.44/hr
White Fiber
$1.75/hr
Genesis Cloud
$2.80/hr
Genesis Cloud
$2.95/hr
IO.NET
$2.39/hr
Jarvis Labs
$3.80/hr
Jarvis Labs
$3.80/hr
Seeweb
$3.01/hr
Seeweb
$3.04/hr
Fluidstack
$2.30/hr
Hyperbolic
$2.40/hr
AceCloud
$7.02/hr
AceCloud
$3.51/hr
AceCloud
$7.02/hr
Together AI
$4.19/hr
Together AI
$3.19/hr
Fireworks AI
$6.00/hr
Crusoe
$4.29/hr
Verda
$3.39/hr
Verda
$3.39/hr
Verda
$3.39/hr
Verda
$3.39/hr
Verda
$3.72/hr

Prices are updated regularly. Last updated: 3/27/2026