Baseten
Inference platform for open and custom models
Baseten is an inference platform that serves popular open models through per-token Model APIs and runs custom or fine-tuned models on dedicated GPU deployments billed per minute, with managed training jobs on the same hardware.
At a glance · prices collected Nov 11, 2026
What's good about Baseten
- Per-minute billing on dedicated GPUs
- Per-token Model APIs and dedicated deployments from one account
- SOC 2 Type II certified and HIPAA compliant
- Multi-GPU instance sizes published with vCPU and memory
Baseten GPU prices
8 GPU models across 34 configurations. Rank compares Baseten's cheapest on-demand listing for each GPU with every provider's cheapest.
| GPU | Baseten | -60%median+100% | Rank | vs. median | Report |
|---|---|---|---|---|---|
| H100 SXM 1× | $6.50/hr | #51 of 56 providers | +103% | ||
| H200 SXM 1× | $7.50/hr | #39 of 44 providers | +65% | ||
| A100 SXM 1× | $4.00/hr | #38 of 41 providers | +150% | ||
| RTX PRO 6000 1× | $4.00/hr | #37 of 40 providers | +85% | ||
| B200 1× | $9.98/hr | #26 of 34 providers | +23% | ||
| L4 1× | $0.85/hr | #12 of 21 providers | +6% | ||
| A10 1× | $1.21/hr | #7 of 13 providers | at median | ||
| Tesla T4 1× | $0.63/hr | #12 of 12 providers | +48% |
All configurations
Prices last updated November 11, 2026
What a run costs on Baseten
24 hours at today's cheapest listing for each GPU, at the size it is listed.
1× H100 SXM for 24 hours
At $6.50/GPU-hr
$156.00
$79.20 over the market median rate
1× H200 SXM for 24 hours
At $7.50/GPU-hr
$180.00
$71.04 over the market median rate
1× A100 SXM for 24 hours
At $4.00/GPU-hr
$96.00
$57.60 over the market median rate
The market median is every provider's cheapest on-demand price for that GPU.
Baseten LLM API prices
Pay-per-token pricing, per 1M tokens.
Prices last updated November 11, 2026
| Model | Input/1M | Output/1M | ||||
|---|---|---|---|---|---|---|
| $0.100 | $0.500 | |||||
| $0.130 | $0.260 | |||||
| $0.150 | $0.500 | |||||
| $0.200 | $0.500 | |||||
| $0.300 | $1.20 | |||||
| $1.25 | $4.25 | |||||
| $1.32 | $3.96 | |||||
| $1.40 | $4.40 | |||||
| $1.40 | $4.40 | |||||
| $2.00 | $10.00 | |||||
Baseten pricing by model
Input, output, and batch rates, plus alternatives, for one model at a time.
Billing & terms
- Model APIs
- Per 1M input, cached input, and output tokens
- Dedicated deployments
- Per minute of GPU instance time, scaled to zero when idle
- Pro and Enterprise
- Volume discounts, priority GPU access, and self-hosted options
- Support
- Email and in-app chat on Basic; dedicated Slack and Zoom support on Pro and Enterprise
Watch out for
- Dedicated GPU rates are higher than raw GPU rental because they include the serving platform
- Model API catalog is a curated set of models
- Volume discounts and custom regions require a sales conversation
Features
- Model APIs
- OpenAI- and Anthropic-compatible endpoints for hosted open models, billed per input, cached input, and output token
- Dedicated deployments
- Custom, fine-tuned, or open-source models on dedicated GPUs from T4 to B200 and RTX PRO 6000, in 1 to 8-GPU instances, with autoscaling
- Training
- Managed training jobs on the same GPU instance types, with checkpoints deployable to inference
- Truss
- Open-source packaging standard for serving models built in any framework
- Self-hosted and hybrid
- Enterprise deployments in the customer's VPC or split across Baseten's cloud and the customer's
Company
Published by Baseten to identify the company behind this listing.
- Headquarters
- 🇺🇸 San Francisco, United States
Getting started
Step 1
Create an account
Sign up; new accounts include credits
Step 2
Call a Model API
Use an OpenAI-compatible client against a hosted model
Step 3
Deploy a model
Package a model with Truss or pick one from the model library and choose a GPU instance type
Where this page's facts come from
- GPU prices
- Baseten (baseten.co) · last collected Nov 11, 2026
- LLM API prices
- baseten.co · last collected Nov 11, 2026
- Profile
- Reviewed Sep 28, 2026
- Method
- How we collect and check prices
Frequently Asked Questions
What GPU types does Baseten offer?
Baseten offers various GPU types including Tesla T4, Tesla T4, Tesla T4, A100 SXM, A100 SXM, A100 SXM, A100 SXM, A100 SXM, A100 SXM, A100 SXM, A100 SXM, H100 SXM, H100 SXM, H100 SXM, H100 SXM, H200 SXM, H200 SXM, H200 SXM, H200 SXM, A10, A10, A10, A10, B200, B200, B200, B200, L4, L4, L4, RTX PRO 6000, RTX PRO 6000, RTX PRO 6000, RTX PRO 6000. Check the pricing table above for current availability and pricing.
How do I get started with Baseten?
Create an account, Call a Model API, Deploy a model
What are Baseten's main advantages?
Baseten's main advantages include: Per-minute billing on dedicated GPUs, Per-token Model APIs and dedicated deployments from one account, SOC 2 Type II certified and HIPAA compliant, Multi-GPU instance sizes published with vCPU and memory.
What are Baseten's limitations?
Baseten's main limitations include: Dedicated GPU rates are higher than raw GPU rental because they include the serving platform, Model API catalog is a curated set of models, Volume discounts and custom regions require a sales conversation.
Compare Providers
Find the best prices for the same GPUs and models from other providers · All Baseten alternatives, ranked →
All Baseten Comparisons
The weekly price report
One email every Monday with the week's notable GPU and LLM API price moves, plus occasional product news. No spam.