Skip to main content
Baseten logo

Baseten

Inference platform for open and custom models

Baseten is an inference platform that serves popular open models through per-token Model APIs and runs custom or fine-tuned models on dedicated GPU deployments billed per minute, with managed training jobs on the same hardware.

At a glance · prices collected Nov 11, 2026

What's good about Baseten

  • Per-minute billing on dedicated GPUs
  • Per-token Model APIs and dedicated deployments from one account
  • SOC 2 Type II certified and HIPAA compliant
  • Multi-GPU instance sizes published with vCPU and memory

Baseten GPU prices

8 GPU models across 34 configurations. Rank compares Baseten's cheapest on-demand listing for each GPU with every provider's cheapest.

Baseten's cheapest on-demand price per GPU against the market median
GPUBaseten-60%median+100%Rankvs. medianReport
H100 SXM

1×

$6.50/hr#51 of 56 providers+103%
H200 SXM

1×

$7.50/hr#39 of 44 providers+65%
A100 SXM

1×

$4.00/hr#38 of 41 providers+150%
RTX PRO 6000

1×

$4.00/hr#37 of 40 providers+85%
B200

1×

$9.98/hr#26 of 34 providers+23%
L4

1×

$0.85/hr#12 of 21 providers+6%
A10

1×

$1.21/hr#7 of 13 providersat median
Tesla T4

1×

$0.63/hr#12 of 12 providers+48%

All configurations

Prices last updated November 11, 2026

A10
$1.21/hr
1×
A10
$1.70/hr
2×4×
A10
$2.44/hr
8×
A100 SXM
$4.00/hr
1×2×3×4×5×6×7×8×
B200
$9.98/hr
1×2×4×8×
H100 SXM
$6.50/hr
1×2×4×8×
H200 SXM
$7.50/hr
1×2×4×8×
L4
$0.850/hr
1×
L4
$1.20/hr
2×4×
RTX PRO 6000
$4.00/hr
1×2×4×8×

What a run costs on Baseten

24 hours at today's cheapest listing for each GPU, at the size it is listed.

  • 1× H100 SXM for 24 hours

    At $6.50/GPU-hr

    $156.00

    $79.20 over the market median rate

  • 1× H200 SXM for 24 hours

    At $7.50/GPU-hr

    $180.00

    $71.04 over the market median rate

  • 1× A100 SXM for 24 hours

    At $4.00/GPU-hr

    $96.00

    $57.60 over the market median rate

The market median is every provider's cheapest on-demand price for that GPU.

Baseten LLM API prices

Pay-per-token pricing, per 1M tokens.

Prices last updated November 11, 2026

ModelInput/1MOutput/1M
$0.100$0.500
$0.130$0.260
$0.150$0.500
$0.200$0.500
$0.300$1.20
$1.25$4.25
$1.32$3.96
$1.40$4.40
$1.40$4.40
$2.00$10.00

Billing & terms

Model APIs
Per 1M input, cached input, and output tokens
Dedicated deployments
Per minute of GPU instance time, scaled to zero when idle
Pro and Enterprise
Volume discounts, priority GPU access, and self-hosted options
Support
Email and in-app chat on Basic; dedicated Slack and Zoom support on Pro and Enterprise

Watch out for

  • Dedicated GPU rates are higher than raw GPU rental because they include the serving platform
  • Model API catalog is a curated set of models
  • Volume discounts and custom regions require a sales conversation

Features

Model APIs
OpenAI- and Anthropic-compatible endpoints for hosted open models, billed per input, cached input, and output token
Dedicated deployments
Custom, fine-tuned, or open-source models on dedicated GPUs from T4 to B200 and RTX PRO 6000, in 1 to 8-GPU instances, with autoscaling
Training
Managed training jobs on the same GPU instance types, with checkpoints deployable to inference
Truss
Open-source packaging standard for serving models built in any framework
Self-hosted and hybrid
Enterprise deployments in the customer's VPC or split across Baseten's cloud and the customer's

Company

Published by Baseten to identify the company behind this listing.

Headquarters
🇺🇸 San Francisco, United States

Getting started

  1. Step 1

    Create an account

    Sign up; new accounts include credits

  2. Step 2

    Call a Model API

    Use an OpenAI-compatible client against a hosted model

  3. Step 3

    Deploy a model

    Package a model with Truss or pick one from the model library and choose a GPU instance type

Where this page's facts come from

GPU prices
  • Baseten (baseten.co) · last collected Nov 11, 2026
LLM API prices
  • baseten.co · last collected Nov 11, 2026
Profile
Reviewed Sep 28, 2026
Method
How we collect and check prices

Frequently Asked Questions

What GPU types does Baseten offer?

Baseten offers various GPU types including Tesla T4, Tesla T4, Tesla T4, A100 SXM, A100 SXM, A100 SXM, A100 SXM, A100 SXM, A100 SXM, A100 SXM, A100 SXM, H100 SXM, H100 SXM, H100 SXM, H100 SXM, H200 SXM, H200 SXM, H200 SXM, H200 SXM, A10, A10, A10, A10, B200, B200, B200, B200, L4, L4, L4, RTX PRO 6000, RTX PRO 6000, RTX PRO 6000, RTX PRO 6000. Check the pricing table above for current availability and pricing.

How do I get started with Baseten?

Create an account, Call a Model API, Deploy a model

What are Baseten's main advantages?

Baseten's main advantages include: Per-minute billing on dedicated GPUs, Per-token Model APIs and dedicated deployments from one account, SOC 2 Type II certified and HIPAA compliant, Multi-GPU instance sizes published with vCPU and memory.

What are Baseten's limitations?

Baseten's main limitations include: Dedicated GPU rates are higher than raw GPU rental because they include the serving platform, Model API catalog is a curated set of models, Volume discounts and custom regions require a sales conversation.

Compare Providers

Find the best prices for the same GPUs and models from other providers · All Baseten alternatives, ranked →

Fluence Cloud logo

Fluence Cloud

8 shared GPUs with Baseten

Compare Prices
Modal logo

Modal

8 shared GPUs with Baseten

Compare Prices
Amazon AWS logo

Amazon AWS

7 shared GPUs with Baseten

Compare Prices

All Baseten Comparisons

Baseten vs Fluence CloudBaseten vs ModalBaseten vs Amazon AWSBaseten vs Google CloudBaseten vs Hugging FaceBaseten vs IO.NETBaseten vs Omega GradientBaseten vs RuncrateBaseten vs ShadeformBaseten vs Vast.aiBaseten vs AquanodeBaseten vs gpu.aiBaseten vs Lium.ioBaseten vs Oracle CloudBaseten vs RunpodBaseten vs SesterceBaseten vs AceCloudBaseten vs CoreWeaveBaseten vs Hexgrid CloudBaseten vs HyperstackBaseten vs Jarvis LabsBaseten vs SpheronBaseten vs VerdaBaseten vs VoltageGPUBaseten vs Akash NetworkBaseten vs CivoBaseten vs Deep InfraBaseten vs fal.aiBaseten vs Lambda LabsBaseten vs LyceumBaseten vs Massed ComputeBaseten vs Microsoft AzureBaseten vs NebiusBaseten vs OpenRelayBaseten vs SeewebBaseten vs Together AIBaseten vs UpCloudBaseten vs CrusoeBaseten vs DaytonaBaseten vs FireVMBaseten vs GcoreBaseten vs GMI CloudBaseten vs GPU OutletBaseten vs HyperbolicBaseten vs Impossible CloudBaseten vs KoyebBaseten vs OVHcloudBaseten vs Pacific MachinesBaseten vs VultrBaseten vs Atlas CloudBaseten vs CloudGPUBaseten vs Compute CheapBaseten vs Denvr DataworksBaseten vs DigitalOceanBaseten vs Latitude.shBaseten vs OblivusBaseten vs Packet AIBaseten vs PaperspaceBaseten vs QuantaCloudBaseten vs ScalewayBaseten vs Theta EdgeCloudBaseten vs Thunder ComputeBaseten vs 1LegionBaseten vs AircloudBaseten vs Akamai CloudBaseten vs Avian ComputeBaseten vs BeamBaseten vs Beyond.plBaseten vs centronBaseten vs Cudo ComputeBaseten vs EcoHashBaseten vs NEOXIS Corp.Baseten vs Novita AIBaseten vs Orion AI FactoryBaseten vs SwissGPUBaseten vs TheAI CloudBaseten vs Voltage ParkBaseten vs ZettabyteBaseten vs BentausBaseten vs Hot AisleBaseten vs LinuxGPUBaseten vs MeshiveBaseten vs NoctHostBaseten vs ParalonCloudBaseten vs QuickPodBaseten vs Salad CloudBaseten vs OpenRouterBaseten vs RouterPlusBaseten vs Prime IntellectBaseten vs PopNowBaseten vs Empirio LabsBaseten vs GeoddBaseten vs HeabsyBaseten vs HiAPIBaseten vs IteraComputeBaseten vs Fireworks AIBaseten vs PerplexityBaseten vs Mistral AIBaseten vs DeepSeekBaseten vs SambaNovaBaseten vs GroqBaseten vs Pareto InferenceBaseten vs AnthropicBaseten vs CerebrasBaseten vs CohereBaseten vs InceptionBaseten vs OpenAIBaseten vs ReplicateBaseten vs xAI

The weekly price report

One email every Monday with the week's notable GPU and LLM API price moves, plus occasional product news. No spam.