Together AI
The AI Native Cloud
Last reviewed Mar 14, 2026
Together AI is the AI Native Cloud platform engineered for developers building with open-source and frontier AI models. They provide serverless inference, fine-tuning, and GPU clusters with inference and training performance optimizations.
Available GPUs
Hourly on-demand pricing. Click column headers to sort.
Prices last updated: October 25, 2026
Together AI pricing by GPU
Configurations, price rank, and alternatives for one GPU at a time.
LLM API Pricing
Pay-per-token pricing. Prices shown per 1M tokens.
Prices last updated: October 25, 2026
| Model | Input/1M | Output/1M | ||||
|---|---|---|---|---|---|---|
| $0.050 | $0.200 | |||||
| $0.060 | $0.250 | |||||
| $0.060 | $0.060 | |||||
| $0.150 | $0.600 | |||||
| $0.150 | $0.470 | |||||
| $0.150 | $1.50 | |||||
| $0.150 | $0.500 | |||||
| $0.150 | $0.600 | |||||
| $0.170 | $0.250 | |||||
| $0.180 | $0.680 | |||||
Together AI pricing by model
Input, output, and batch rates, plus alternatives, for one model at a time.
Pros & Cons
Advantages
- 2x faster inference and 90% faster pre-training with research-based optimizations
- Competitive pricing with 50% batch API discount
- Wide selection of 100+ open-source models
- OpenAI-compatible APIs for easy migration
- Research leadership with FlashAttention contributions
- Global data center network across 25+ cities
Limitations
- Primarily focused on open-source models
- GPU cluster pricing requires custom quotes for reserved capacity
- Smaller ecosystem compared to major cloud providers
Key Features
100+ Open-Source Models
Access to Llama, DeepSeek, Qwen, and other leading open-source models
Serverless Inference
Pay-per-token API with OpenAI-compatible endpoints
Fine-Tuning Platform
LoRA and full fine-tuning with proprietary optimizations
GPU Clusters
Instant self-service or reserved dedicated clusters with H100, H200, B200, GB200, GB300 access
Batch API
50% cost reduction for non-urgent inference workloads
Provisioned Throughput
Reserve dedicated capacity in throughput units (PTUs) with SLAs
Code Interpreter
Execute LLM-generated code in sandboxed environments
AI Factory
Custom infrastructure at frontier scale
Sandbox
Build development environments for AI
Managed Storage
Store model weights & data securely
Dedicated Inference
Deploy models on custom hardware with guaranteed performance
Evaluations
Measure model quality
Pricing Options
| Option | Details |
|---|---|
| Serverless pay-per-token | Per-token pricing scales based on model size, from small open-source models to 405B parameter frontier models |
| Batch API | 50% discount for non-urgent inference workloads |
| Provisioned Throughput | Reserve dedicated capacity priced in throughput units (PTUs) with guaranteed SLAs |
| Fine-tuning | Per-token pricing for LoRA and full fine-tuning based on model size and dataset |
| GPU Clusters - On-demand | Hourly GPU pricing for instant self-service clusters |
| GPU Clusters - Reserved | Custom pricing for reserved capacity with significant discounts for longer commitments |
| Dedicated Inference | Single-tenant GPU instances with guaranteed performance |
Availability & Support
Regions
Global data center network across 25+ cities with frontier hardware including GB300, GB200, B200, H200, H100
Support
Documentation, community Discord, email support, and expert support for reserved cluster customers
Getting Started
- 1
Create an account
Sign up at together.ai
- 2
Get API key
Generate an API key from your dashboard
- 3
Choose a model
Browse 100+ models for chat, code, images, video, and audio
- 4
Make API calls
Use OpenAI-compatible endpoints or Together SDK
Frequently Asked Questions
What GPU types does Together AI offer?
Together AI offers various GPU types including A100 PCIE, A100 PCIE, A100 PCIE, A100 PCIE, A100 SXM, A100 SXM, A100 SXM, A100 SXM, H100 SXM, H100 SXM, H100 SXM, H100 SXM, H200, H200, H200, H200, L40, L40, L40, L40, RTX 6000 Ada, RTX 6000 Ada, RTX 6000 Ada, RTX 6000 Ada, L40S, L40S, L40S, L40S, B200, B200, B200, B200. Check the pricing table above for current availability and pricing.
How do I get started with Together AI?
Create an account, Get API key, Choose a model, Make API calls
What are Together AI's main advantages?
Together AI's main advantages include: 2x faster inference and 90% faster pre-training with research-based optimizations, Competitive pricing with 50% batch API discount, Wide selection of 100+ open-source models, OpenAI-compatible APIs for easy migration, Research leadership with FlashAttention contributions, Global data center network across 25+ cities.
What are Together AI's limitations?
Together AI's main limitations include: Primarily focused on open-source models, GPU cluster pricing requires custom quotes for reserved capacity, Smaller ecosystem compared to major cloud providers.
Compare Providers
Find the best prices for the same GPUs and models from other providers
