Fireworks AI

The fastest platform for open-source AI

Inference specialist๐Ÿ‡บ๐Ÿ‡ธ USinferenceopen-sourcefast

Fireworks AI is a high-performance inference platform specializing in open-source generative AI models. Founded by former Meta PyTorch team members, they provide the fastest inference engine for LLMs, vision, and audio models with enterprise-grade reliability.

4
GPU Models
$2.90
From / hour

Available GPUs

Hourly on-demand pricing. Click column headers to sort.

Prices last updated: January 30, 2026

GPU Modelโ†‘
Memoryโ†‘
Price / hrโ†‘
A100 SXM80GB$2.90/hr
B200192GB$9.00/hr
H10080GB$4.00/hr
H200141GB$6.00/hr

Pros & Cons

Advantages

  • Lightning-fast inference with industry-leading response times
  • Easy-to-use API with excellent OpenAI compatibility
  • Wide variety of optimized open-source models
  • Competitive pricing with 50% off cached tokens and batch processing
  • Enterprise reliability with 99.99% uptime SLA
  • Up to 100 fine-tuned models deployable without extra costs

Limitations

  • Limited capacity with some serverless model limits
  • Primarily focused on language models over image/video generation
  • BYOC only available for major enterprise customers
  • Feature-rich interface can have steep learning curve

Key Features

400+ Open-Source Models

Instant access to Llama, DeepSeek, Qwen, Mixtral, FLUX, Whisper, and more

Blazing Fast Inference

Industry-leading throughput and latency processing 140B+ tokens daily

Fine-Tuning Suite

SFT, DPO, and reinforcement fine-tuning with LoRA efficiency

OpenAI-Compatible API

Drop-in replacement for easy migration from OpenAI

On-Demand GPUs

A100, H100, H200, and B200 deployments with per-second billing

Batch Processing

50% discount for async bulk inference workloads

Pricing Options

OptionDetails
Serverless pay-per-tokenStarting at $0.10/1M tokens for small models, $0.90/1M for large models
Cached tokens50% discount on cached input tokens
Batch processing50% discount on async bulk inference
On-demand GPUsPer-second billing from $2.90/hr (A100) to $9.00/hr (B200)

Availability & Support

Regions

18+ global regions across 8 cloud providers with multi-region deployments and BYOC support for enterprise

Support

Documentation, Discord community, status page, email support, and dedicated enterprise support with SLAs

Getting Started

  1. 1

    Explore Model Library

    Browse 400+ models at fireworks.ai/models

  2. 2

    Test in Playground

    Experiment with prompts interactively without coding

  3. 3

    Generate API Key

    Create an API key from user settings in your account

  4. 4

    Make first API call

    Use OpenAI-compatible endpoints or Fireworks SDK

  5. 5

    Scale to production

    Transition to on-demand GPU deployments for production workloads

Compare Providers

Find the best prices for the same GPUs from other providers

Deep Infra logo

Deep Infra

4 shared GPUs with Fireworks AI

CoreWeave logo

CoreWeave

4 shared GPUs with Fireworks AI

RunPod logo

RunPod

4 shared GPUs with Fireworks AI