Skip to main content
SambaNova logo

SambaNova

Inference on custom dataflow hardware

SambaNova builds its own AI accelerator, the Reconfigurable Dataflow Unit (RDU), and runs SambaNova Cloud, an OpenAI-compatible inference API for open models served on that hardware and billed per token.

At a glance · prices collected Nov 11, 2026

What's good about SambaNova

  • Serves models on non-GPU hardware built for inference
  • Public per-token rates for every served model
  • OpenAI-compatible endpoints

SambaNova LLM API prices

Pay-per-token pricing, per 1M tokens.

Prices last updated November 11, 2026

ModelInput/1MOutput/1M
$0.220$0.590
$0.300$1.20
$0.380$1.15
$2.80$8.80

Billing & terms

Per token
Input, cached input, and output tokens billed per 1M
Commits
Prepaid usage commitments
Support
Documentation and the SambaNova Cloud dashboard

Watch out for

  • Small model catalog compared with GPU-based inference providers
  • Some models are priced above other providers of the same open weights
  • No GPU rental; inference only

Features

Custom RDU hardware
Models run on SambaNova's own Reconfigurable Dataflow Units rather than GPUs
OpenAI-compatible API
Chat completions for open models such as DeepSeek, Llama, Gemma, MiniMax and gpt-oss
Prompt caching
Cached input tokens billed at a reduced rate on supported models
Commits and credits
Prepaid commitments alongside pay-as-you-go billing

Company

Published by SambaNova to identify the company behind this listing.

Headquarters
🇺🇸 Palo Alto, United States

Getting started

  1. Step 1

    Create an account

    Sign up on SambaNova Cloud

  2. Step 2

    Create an API key

    Generate a key in the API Keys page

  3. Step 3

    Call the API

    Point an OpenAI-compatible client at api.sambanova.ai

Where this page's facts come from

LLM API prices
  • cloud.sambanova.ai · last collected Nov 11, 2026
Profile
Reviewed Sep 28, 2026
Method
How we collect and check prices

Frequently Asked Questions

Which models does SambaNova serve?

Check the pricing table above for the models SambaNova currently serves and their per-token rates.

How do I get started with SambaNova?

Create an account, Create an API key, Call the API

What are SambaNova's main advantages?

SambaNova's main advantages include: Serves models on non-GPU hardware built for inference, Public per-token rates for every served model, OpenAI-compatible endpoints.

What are SambaNova's limitations?

SambaNova's main limitations include: Small model catalog compared with GPU-based inference providers, Some models are priced above other providers of the same open weights, No GPU rental; inference only.

The weekly price report

One email every Monday with the week's notable GPU and LLM API price moves, plus occasional product news. No spam.