Baseten vs OpenRelay
Compare GPU and LLM inference API pricing between Baseten and OpenRelay. Find the best rates for AI training, inference, and ML workloads.
Baseten
Provider 1
8
GPUs Available
OpenRelay
Provider 2
9
GPUs Available
Comparison Overview
13
Total GPU Models
8
Baseten GPUs
9
OpenRelay GPUs
4
Direct Comparisons
Average Price Difference: $3.43/hour between comparable GPUs
GPU Pricing Comparison
Total GPUs: 13Both available: 4Baseten: 8OpenRelay: 9
Showing 13 of 13 GPUs
Last updated: 10/5/2026, 2:54:39 PM
| GPU Model ↑ | Baseten Price | OpenRelay Price | Price Diff ↕ | Sources |
|---|---|---|---|---|
A10 24GB VRAM • Baseten |  $1.21/hr★ Best | Not Available | — | |
A10 24GB VRAM • | ||||
A100 SXM 80GB VRAM • BasetenOpenRelay | $4.00/hr 3x GPU |  $1.10/hr★ Best | ↑+$2.90(+263.6%) | |
B200 180GB VRAM • BasetenOpenRelay | $9.98/hr | $5.50/hr★ Best | ↑+$4.48(+81.5%) | |
H100 SXM 80GB VRAM • BasetenOpenRelay | $6.50/hr | $2.60/hr★ Best | ↑+$3.90(+150.0%) | |
H200 141GB VRAM • Baseten | $7.50/hr★ Best | Not Available | — | |
H200 141GB VRAM • | ||||
HGX B300 288GB VRAM • OpenRelay | Not Available | $7.49/hr★ Best | — | |
HGX B300 288GB VRAM • | ||||
L4 24GB VRAM • Baseten | $0.85/hr★ Best | Not Available | — | |
L4 24GB VRAM • | ||||
MI355X 288GB VRAM • OpenRelay | Not Available | $5.50/hr★ Best | — | |
MI355X 288GB VRAM • | ||||
RTX 3090 24GB VRAM • OpenRelay | Not Available | $0.18/hr★ Best | — | |
RTX 3090 24GB VRAM • | ||||
RTX 4090 24GB VRAM • OpenRelay | Not Available | $0.35/hr★ Best | — | |
RTX 4090 24GB VRAM • | ||||
RTX 5090 32GB VRAM • OpenRelay | Not Available | $0.60/hr★ Best | — | |
RTX 5090 32GB VRAM • | ||||
RTX PRO 6000 96GB VRAM • BasetenOpenRelay | $4.00/hr | $1.55/hr★ Best | ↑+$2.45(+158.1%) | |
Tesla T4 16GB VRAM • Baseten | $0.63/hr★ Best | Not Available | — | |
Tesla T4 16GB VRAM • | ||||
A10 24GB VRAM • Baseten | $1.21/hr★ Best | Not Available | — | |
A10 24GB VRAM • | ||||
A100 SXM 80GB VRAM • BasetenOpenRelay | $4.00/hr 3x GPU | $1.10/hr★ Best | ↑+$2.90(+263.6%) | |
B200 180GB VRAM • BasetenOpenRelay | $9.98/hr | $5.50/hr★ Best | ↑+$4.48(+81.5%) | |
H100 SXM 80GB VRAM • BasetenOpenRelay | $6.50/hr | $2.60/hr★ Best | ↑+$3.90(+150.0%) | |
H200 141GB VRAM • Baseten | $7.50/hr★ Best | Not Available | — | |
H200 141GB VRAM • | ||||
HGX B300 288GB VRAM • OpenRelay | Not Available | $7.49/hr★ Best | — | |
HGX B300 288GB VRAM • | ||||
L4 24GB VRAM • Baseten | $0.85/hr★ Best | Not Available | — | |
L4 24GB VRAM • | ||||
MI355X 288GB VRAM • OpenRelay | Not Available | $5.50/hr★ Best | — | |
MI355X 288GB VRAM • | ||||
RTX 3090 24GB VRAM • OpenRelay | Not Available | $0.18/hr★ Best | — | |
RTX 3090 24GB VRAM • | ||||
RTX 4090 24GB VRAM • OpenRelay | Not Available | $0.35/hr★ Best | — | |
RTX 4090 24GB VRAM • | ||||
RTX 5090 32GB VRAM • OpenRelay | Not Available | $0.60/hr★ Best | — | |
RTX 5090 32GB VRAM • | ||||
RTX PRO 6000 96GB VRAM • BasetenOpenRelay | $4.00/hr | $1.55/hr★ Best | ↑+$2.45(+158.1%) | |
Tesla T4 16GB VRAM • Baseten | $0.63/hr★ Best | Not Available | — | |
Tesla T4 16GB VRAM • | ||||
LLM API Pricing Comparison
Total models: 11Both available: 4Baseten: 8OpenRelay: 7
Showing 11 of 11 models
Prices per 1M tokens · Last updated: 10/5/2026, 2:54:39 PM
| Model ↑ | Baseten | OpenRelay | Input Diff ↕ |
|---|---|---|---|
BAAI | Not available | $0.013 in $0.0000 out | — |
DeepSeek | $0.130 in $0.260 out | $0.220 in $0.660 out | $0.090 |
DeepSeek | $1.32 in $3.96 out | Not available | — |
DeepSeek | $0.300 in $1.20 out | Not available | — |
Zhipu | $1.40 in $4.40 out | $1.82 in $5.72 out | $0.420 |
Z AI | $1.40 in $4.40 out | Not available | — |
Z AI | $0.150 in $0.500 out | $0.195 in $0.650 out | $0.045 |
OpenAI | $0.100 in $0.500 out | $0.150 in $0.600 out | $0.050 |
OpenAI | Not available | $0.050 in $0.200 out | — |
Moonshot | $3.00 in $15.00 out | Not available | — |
Alibaba | Not available | $0.420 in $3.00 out | — |
Related Comparisons
Explore how these providers compare to other popular GPU cloud services
Baseten vs Amazon AWS
PopularCompare Baseten with another leading provider
Baseten vs Google Cloud
PopularCompare Baseten with another leading provider
Baseten vs Microsoft Azure
PopularCompare Baseten with another leading provider
Baseten vs CoreWeave
PopularCompare Baseten with another leading provider
Baseten vs Runpod
PopularCompare Baseten with another leading provider
Baseten vs Lambda Labs
PopularCompare Baseten with another leading provider