A100 PCIE GPU
The A100 PCIe delivers strong AI training and HPC performance in a standard PCIe form factor, supporting multi-instance GPU partitioning for flexible workload sharing. It enables large-scale AI and scientific computing with improved efficiency over older GPUs.
Starting Price
$0.29/hr
Available on 32 cloud providers
Key Specifications
💾Memory
40GB VRAM
🏗️Architecture
Ampere
⚙️Compute Units
N/A
🧮Tensor Cores
432
Technical Specifications
Hardware Details
ManufacturerNVIDIA
ArchitectureAmpere
CUDA Cores6912
Tensor Cores432
RT CoresN/A
Compute UnitsN/A
GenerationN/A
Memory & Performance
VRAM40GB
Memory Interface5120-bit
Memory Bandwidth1555 GB/s
FP32 Performance19.5 TFLOPS
FP16 Performance312 TFLOPS
INT8 Performance624 TOPS
Performance
Computing Power
CUDA Cores6,912
Tensor Cores432
Computational Performance
FP32 (TFLOPS)19.5
FP16 (TFLOPS)312
INT8 (TOPS)624
Common Use Cases
AI training, HPC
Machine Learning & AI
- Training large language models and transformers
- Computer vision and image processing
- Deep learning model development
- High-performance inference workloads
Graphics & Compute
- 3D rendering and visualization
- Scientific simulations
- Data center graphics virtualization
- High-performance computing (HPC)
Market Context
The A100 PCIE sits within NVIDIA’s Ampere architecture lineup, positioned in the ultra performance tier.
Cloud Availability
Available across 32 cloud providers with prices ranging from $0.29/hr. Pricing and availability may vary by region and provider.
Market Position
Released in 2020, this GPU is positioned for professional workloads.
Current Pricing
| Provider | Hourly Price | Source |
|---|---|---|
RunPod | $1.19/hr | |
RunPod | $1.89/hr | |
RunPod | $0.60/hr | |
Amazon AWS | $1.48/hr | |
Vast.ai | $0.29/hr | |
Vast.ai | $0.87/hr | |
Hyperstack | $1.35/hr | |
Lambda Labs | $1.29/hr | |
Lambda Labs | $1.29/hr | |
Lambda Labs | $1.29/hr | |
Lambda Labs | $1.29/hr | |
Fluidstack | $1.80/hr | |
Vultr | $1.29/hr | |
Vultr | $1.29/hr | |
Together AI | $2.40/hr | |
Crusoe | $1.45/hr | |
Crusoe | $1.45/hr | |
Crusoe | $1.45/hr | |
Crusoe | $1.45/hr | |
Crusoe | $1.00/hr | |
Cudo Compute | $1.35/hr | |
Cudo Compute | $1.50/hr | |
Massed Compute | $1.20/hr | |
Massed Compute | $2.40/hr | |
Massed Compute | $4.80/hr | |
Massed Compute | $9.60/hr | |
TensorDock | $1.50/hr | |
Verda | $0.72/hr | |
Verda | $0.65/hr | |
Verda | $1.29/hr | |
Verda | $0.72/hr | |
Verda | $1.29/hr |
Prices are updated regularly. Last updated: 3/24/2026