Loading page
Together AI
The AI Native Cloud
Inference specialist🇺🇸 USinferenceopen-sourcetraining
Last reviewed Mar 14, 2026
Together AI is the AI Native Cloud platform engineered for developers building with open-source and frontier AI models. They provide serverless inference, fine-tuning, and GPU clusters with industry-leading performance optimizations.
Available GPUs
Hourly on-demand pricing. Click column headers to sort.
Prices last updated: September 8, 2026
Together AI pricing by GPU
Configurations, price rank, and alternatives for one GPU at a time.
LLM API Pricing
Pay-per-token pricing. Prices shown per 1M tokens.
Prices last updated: September 8, 2026
| Model | Input/1M | Output/1M | |||
|---|---|---|---|---|---|
| $0.050 | $0.200 | ||||
| $0.060 | $0.250 | ||||
| $0.060 | $0.060 | ||||
| $0.060 | $0.060 | ||||
| $0.140 | $0.280 | ||||
| $0.150 | $0.470 | ||||
| $0.150 | $1.50 | ||||
| $0.150 | $0.500 | ||||
| $0.150 | $0.600 | ||||
| $0.150 | $1.50 | ||||
Together AI pricing by model
Input, output, and batch rates, plus alternatives, for one model at a time.
Pros & Cons
Advantages
- 2x faster inference and 90% faster pre-training with cutting-edge research optimizations
- Competitive pricing with 50% batch API discount
- Wide selection of 100+ open-source models
- OpenAI-compatible APIs for easy migration
- Research leadership with FlashAttention contributions
- Global data center network across 25+ cities
Limitations
- Primarily focused on open-source models
- GPU cluster pricing requires custom quotes for reserved capacity
- Smaller ecosystem compared to major cloud providers
Key Features
100+ Open-Source Models
Access to Llama, DeepSeek, Qwen, and other leading open-source models
Serverless Inference
Pay-per-token API with OpenAI-compatible endpoints
Fine-Tuning Platform
LoRA and full fine-tuning with proprietary optimizations
GPU Clusters
Instant self-service or reserved dedicated clusters with H100, H200, B200, GB200, GB300 access
Batch API
50% cost reduction for non-urgent inference workloads
Provisioned Throughput
Reserve dedicated capacity in throughput units (PTUs) with SLAs
Code Interpreter
Execute LLM-generated code in sandboxed environments
AI Factory
Custom infrastructure at frontier scale
Sandbox
Build development environments for AI
Managed Storage
Store model weights & data securely
Dedicated Inference
Deploy models on custom hardware with guaranteed performance
Evaluations
Measure model quality
Pricing Options
| Option | Details |
|---|---|
| Serverless pay-per-token | Per-token pricing scales based on model size, from small open-source models to 405B parameter frontier models |
| Batch API | 50% discount for non-urgent inference workloads |
| Provisioned Throughput | Reserve dedicated capacity priced in throughput units (PTUs) with guaranteed SLAs |
| Fine-tuning | Per-token pricing for LoRA and full fine-tuning based on model size and dataset |
| GPU Clusters - On-demand | Hourly GPU pricing for instant self-service clusters |
| GPU Clusters - Reserved | Custom pricing for reserved capacity with significant discounts for longer commitments |
| Dedicated Inference | Single-tenant GPU instances with guaranteed performance |
Availability & Support
Regions
Global data center network across 25+ cities with frontier hardware including GB300, GB200, B200, H200, H100
Support
Documentation, community Discord, email support, and expert support for reserved cluster customers
Getting Started
- 1
Create an account
Sign up at together.ai
- 2
Get API key
Generate an API key from your dashboard
- 3
Choose a model
Browse 100+ models for chat, code, images, video, and audio
- 4
Make API calls
Use OpenAI-compatible endpoints or Together SDK
Frequently Asked Questions
What GPU types does Together AI offer?
Together AI offers various GPU types including A100 PCIE, A100 PCIE, A100 PCIE, A100 PCIE, A100 SXM, A100 SXM, A100 SXM, A100 SXM, H100 SXM, H100 SXM, H100 SXM, H100 SXM, H200, H200, H200, H200, L40, L40, L40, L40, RTX 6000 Ada, RTX 6000 Ada, RTX 6000 Ada, RTX 6000 Ada, L40S, L40S, L40S, L40S, B200, B200, B200, B200. Check the pricing table above for current availability and pricing.
How do I get started with Together AI?
Create an account, Get API key, Choose a model, Make API calls
What are Together AI's main advantages?
Together AI's main advantages include: 2x faster inference and 90% faster pre-training with cutting-edge research optimizations, Competitive pricing with 50% batch API discount, Wide selection of 100+ open-source models, OpenAI-compatible APIs for easy migration, Research leadership with FlashAttention contributions, Global data center network across 25+ cities.
What are Together AI's limitations?
Together AI's main limitations include: Primarily focused on open-source models, GPU cluster pricing requires custom quotes for reserved capacity, Smaller ecosystem compared to major cloud providers.
Compare Providers
Find the best prices for the same GPUs and models from other providers
All Together AI Comparisons
Together AI vs AtmosComputeTogether AI vs GPU OutletTogether AI vs RunpodTogether AI vs IO.NETTogether AI vs Massed ComputeTogether AI vs Omega GradientTogether AI vs RuncrateTogether AI vs VerdaTogether AI vs CivoTogether AI vs CoreWeaveTogether AI vs HyperstackTogether AI vs ModalTogether AI vs ShadeformTogether AI vs 1LegionTogether AI vs AceCloudTogether AI vs CrusoeTogether AI vs Lium.ioTogether AI vs LyceumTogether AI vs OblivusTogether AI vs Oracle CloudTogether AI vs SesterceTogether AI vs SpheronTogether AI vs Amazon AWSTogether AI vs Deep InfraTogether AI vs DigitalOceanTogether AI vs GcoreTogether AI vs Google CloudTogether AI vs Jarvis LabsTogether AI vs KoyebTogether AI vs SeewebTogether AI vs VultrTogether AI vs BeamTogether AI vs Cudo ComputeTogether AI vs Denvr DataworksTogether AI vs Genesis CloudTogether AI vs GMI CloudTogether AI vs HyperbolicTogether AI vs Lambda LabsTogether AI vs Microsoft AzureTogether AI vs NebiusTogether AI vs UpCloudTogether AI vs Atlas CloudTogether AI vs Compute CheapTogether AI vs Novita AITogether AI vs Packet AITogether AI vs PaperspaceTogether AI vs ScalewayTogether AI vs Thunder ComputeTogether AI vs Beyond.plTogether AI vs fal.aiTogether AI vs HinodeTogether AI vs Latitude.shTogether AI vs SwissGPUTogether AI vs Theta EdgeCloudTogether AI vs Voltage ParkTogether AI vs ZettabyteTogether AI vs Akamai CloudTogether AI vs AquanodeTogether AI vs EcoHashTogether AI vs Hot AisleTogether AI vs QuickPodTogether AI vs Salad CloudTogether AI vs Vast.aiTogether AI vs OpenRouterTogether AI vs Fireworks AITogether AI vs GroqTogether AI vs WaferTogether AI vs CerebrasTogether AI vs Mistral AITogether AI vs AnthropicTogether AI vs CohereTogether AI vs OpenAITogether AI vs PerplexityTogether AI vs Replicate