What is the difference between Deep Infra and Together AI?

Deep Infra and Together AI are both cloud GPU providers offering different pricing models, features, and GPU availability. Use our comparison tool to see real-time pricing and feature differences.

Which is cheaper: Deep Infra or Together AI?

Pricing varies by GPU model and usage requirements. Check our real-time comparison table to find the best deals for your specific needs.

Can I switch between Deep Infra and Together AI?

Yes, both providers offer flexible cloud GPU services. However, consider factors like data transfer costs, setup time, and specific features when switching between providers.

How many GPU models are available for comparison?

We track pricing for 9 different GPU models across both Deep Infra and Together AI, with 0 models available from both providers.

Deep Infra vs Together AI

Compare GPU and LLM inference API pricing between Deep Infra and Together AI. Find the best rates for AI training, inference, and ML workloads.

Deep Infra

Provider 1

GPUs Available

Visit Website

Together AI

Provider 2

GPUs Available

Visit Website

Comparison Overview

Total GPU Models

Deep Infra GPUs

Together AI GPUs

Direct Comparisons

Average Price Difference: $2.66/hour between comparable GPUs

GPU Pricing Comparison

Total GPUs: 9Both available: 4Deep Infra: 5Together AI: 8

Showing 9 of 9 GPUs

Last updated: 10/26/2026, 2:57:57 AM

GPU Model ↑	Deep Infra Price	Together AI Price	Price Diff ↕	Sources
A100 PCIE 40GB VRAM • Together AI	Not Available	$2.40/hr★ Best	—	Together AI Hardware API
A100 PCIE 40GB VRAM • Not Available Together AI $2.40/hour Updated: 10/25/2026 ★Best Price Together AI Hardware API
A100 SXM 80GB VRAM • Deep InfraTogether AI	$1.49/hr★ Best	$2.40/hr	↓$0.91(37.9%)	Deep Infra Together AI Hardware API
A100 SXM 80GB VRAM • Deep Infra $1.49/hour Updated: 10/25/2026 ★Best Price Together AI $2.40/hour Updated: 10/25/2026 Price Difference:↓$0.91(37.9%) Deep Infra Together AI Hardware API
B200 180GB VRAM • Deep InfraTogether AI	$4.89/hr★ Best	$9.00/hr	↓$4.11(45.7%)	Deep Infra Together AI Hardware API
B200 180GB VRAM • Deep Infra $4.89/hour Updated: 10/25/2026 ★Best Price Together AI $9.00/hour Updated: 10/25/2026 Price Difference:↓$4.11(45.7%) Deep Infra Together AI Hardware API
H100 SXM 80GB VRAM • Deep InfraTogether AI	$2.90/hr★ Best	$5.40/hr	↓$2.50(46.3%)	Deep Infra Together AI Hardware API
H100 SXM 80GB VRAM • Deep Infra $2.90/hour Updated: 10/25/2026 ★Best Price Together AI $5.40/hour Updated: 10/25/2026 Price Difference:↓$2.50(46.3%) Deep Infra Together AI Hardware API
H200 141GB VRAM • Deep InfraTogether AI	$3.49/hr★ Best	$6.60/hr	↓$3.11(47.1%)	Deep Infra Together AI Hardware API
H200 141GB VRAM • Deep Infra $3.49/hour Updated: 10/25/2026 ★Best Price Together AI $6.60/hour Updated: 10/25/2026 Price Difference:↓$3.11(47.1%) Deep Infra Together AI Hardware API
HGX B300 288GB VRAM • Deep Infra	$5.89/hr★ Best	Not Available	—	Deep Infra
HGX B300 288GB VRAM • Deep Infra $5.89/hour Updated: 10/25/2026 ★Best Price Not Available Deep Infra
L40 40GB VRAM • Together AI	Not Available	$1.49/hr★ Best	—	Together AI Hardware API
L40 40GB VRAM • Not Available Together AI $1.49/hour Updated: 10/25/2026 ★Best Price Together AI Hardware API
L40S 48GB VRAM • Together AI	Not Available	$2.10/hr★ Best	—	Together AI Hardware API
L40S 48GB VRAM • Not Available Together AI $2.10/hour Updated: 10/25/2026 ★Best Price Together AI Hardware API
RTX 6000 Ada 48GB VRAM • Together AI	Not Available	$1.49/hr★ Best	—	Together AI Hardware API
RTX 6000 Ada 48GB VRAM • Not Available Together AI $1.49/hour Updated: 10/25/2026 ★Best Price Together AI Hardware API

A100 PCIE 40GB VRAM • Together AI	Not Available	$2.40/hr★ Best	—	Together AI Hardware API
A100 PCIE 40GB VRAM • Not Available Together AI $2.40/hour Updated: 10/25/2026 ★Best Price Together AI Hardware API
A100 SXM 80GB VRAM • Deep InfraTogether AI	$1.49/hr★ Best	$2.40/hr	↓$0.91(37.9%)	Deep Infra Together AI Hardware API
A100 SXM 80GB VRAM • Deep Infra $1.49/hour Updated: 10/25/2026 ★Best Price Together AI $2.40/hour Updated: 10/25/2026 Price Difference:↓$0.91(37.9%) Deep Infra Together AI Hardware API
B200 180GB VRAM • Deep InfraTogether AI	$4.89/hr★ Best	$9.00/hr	↓$4.11(45.7%)	Deep Infra Together AI Hardware API
B200 180GB VRAM • Deep Infra $4.89/hour Updated: 10/25/2026 ★Best Price Together AI $9.00/hour Updated: 10/25/2026 Price Difference:↓$4.11(45.7%) Deep Infra Together AI Hardware API
H100 SXM 80GB VRAM • Deep InfraTogether AI	$2.90/hr★ Best	$5.40/hr	↓$2.50(46.3%)	Deep Infra Together AI Hardware API
H100 SXM 80GB VRAM • Deep Infra $2.90/hour Updated: 10/25/2026 ★Best Price Together AI $5.40/hour Updated: 10/25/2026 Price Difference:↓$2.50(46.3%) Deep Infra Together AI Hardware API
H200 141GB VRAM • Deep InfraTogether AI	$3.49/hr★ Best	$6.60/hr	↓$3.11(47.1%)	Deep Infra Together AI Hardware API
H200 141GB VRAM • Deep Infra $3.49/hour Updated: 10/25/2026 ★Best Price Together AI $6.60/hour Updated: 10/25/2026 Price Difference:↓$3.11(47.1%) Deep Infra Together AI Hardware API
HGX B300 288GB VRAM • Deep Infra	$5.89/hr★ Best	Not Available	—	Deep Infra
HGX B300 288GB VRAM • Deep Infra $5.89/hour Updated: 10/25/2026 ★Best Price Not Available Deep Infra
L40 40GB VRAM • Together AI	Not Available	$1.49/hr★ Best	—	Together AI Hardware API
L40 40GB VRAM • Not Available Together AI $1.49/hour Updated: 10/25/2026 ★Best Price Together AI Hardware API
L40S 48GB VRAM • Together AI	Not Available	$2.10/hr★ Best	—	Together AI Hardware API
L40S 48GB VRAM • Not Available Together AI $2.10/hour Updated: 10/25/2026 ★Best Price Together AI Hardware API
RTX 6000 Ada 48GB VRAM • Together AI	Not Available	$1.49/hr★ Best	—	Together AI Hardware API
RTX 6000 Ada 48GB VRAM • Not Available Together AI $1.49/hour Updated: 10/25/2026 ★Best Price Together AI Hardware API

LLM API Pricing Comparison

Total models: 100Both available: 19Deep Infra: 65Together AI: 54

Showing 15 of 100 models

Prices per 1M tokens · Last updated: 10/26/2026, 2:57:57 AM

Model ↑	Deep Infra	Together AI	Input Diff ↕
Claude Fable 5 Anthropic	$10.00 in $50.00 out	Not available	—
Claude Haiku 4.5 Anthropic	$1.00 in $5.00 out	Not available	—
Claude Opus 4.7 Anthropic	$5.00 in $25.00 out	Not available	—
Claude Opus 4.8 Anthropic	$5.00 in $25.00 out	Not available	—
Claude Opus 5 Anthropic	$5.00 in $25.00 out	Not available	—
Claude Opus 5.5 Anthropic	$4.00 in $20.00 out	Not available	—
Claude Sonnet 4.6 Anthropic	$3.00 in $15.00 out	Not available	—
Claude Sonnet 5 Anthropic	$3.00 in $15.00 out	Not available	—
Claude Sonnet 5.5 Anthropic	$2.00 in $10.00 out	Not available	—
DeepSeek Coder 33B DeepSeek	Not available	$0.800 in $0.800 out	—
DeepSeek R1 DeepSeek	$0.500 in $2.15 out	Not available	—
DeepSeek R1 Distill Llama 70B DeepSeek	Not available	$2.00 in $2.00 out	—
DeepSeek R1 Distill Qwen 1.5B DeepSeek	Not available	$0.180 in $0.180 out	—
DeepSeek R1 Distill Qwen 14B DeepSeek	Not available	$1.60 in $1.60 out	—
DeepSeek V3 DeepSeek	$0.320 in $0.890 out	Not available	—

Features Comparison

Deep Infra

Drop-in OpenAI Replacement
OpenAI-compatible API for 100+ models including DeepSeek, Qwen, Llama 4, Claude, and Gemini families with autoscaling
Dedicated GPU Rentals
B200 instances with SSH access spin up in about 10 seconds and bill hourly
Custom LLM Deployments
Deploy your own Hugging Face models onto dedicated A100, H100, H200, B200, or B300 GPUs
Transparent GPU Pricing
Published per-GPU hourly rates for A100, H100, H200, B200, and B300 with competitive pricing
Owned Inference Infrastructure
Runs on its own inference-optimized hardware in US-based data centers rather than rented capacity
Comprehensive AI APIs
Support for text generation, vision and OCR, embeddings and reranking, image, video and music generation, and speech recognition and synthesis

Together AI

100+ Open-Source Models
Access to Llama, DeepSeek, Qwen, and other leading open-source models
Serverless Inference
Pay-per-token API with OpenAI-compatible endpoints
Fine-Tuning Platform
LoRA and full fine-tuning with proprietary optimizations
GPU Clusters
Instant self-service or reserved dedicated clusters with H100, H200, B200, GB200, GB300 access
Batch API
50% cost reduction for non-urgent inference workloads
Provisioned Throughput
Reserve dedicated capacity in throughput units (PTUs) with SLAs

Pros & Cons

Deep Infra

Advantages

Simple OpenAI-compatible API alongside controllable GPU rentals
Competitive hourly rates for NVIDIA GPUs including B200 and B300
Fast provisioning with SSH access for dedicated instances (ready in ~10 seconds)
Supports custom deployments in addition to hosted public models

Considerations

Infrastructure is US-based only, with no published international regions
Primarily focused on inference and GPU rentals rather than broader cloud services
Newer player compared to established cloud providers

Together AI

Advantages

2x faster inference and 90% faster pre-training with research-based optimizations
Competitive pricing with 50% batch API discount
Wide selection of 100+ open-source models
OpenAI-compatible APIs for easy migration

Considerations

Primarily focused on open-source models
GPU cluster pricing requires custom quotes for reserved capacity
Smaller ecosystem compared to major cloud providers

Compute Services

Deep Infra

Serverless Inference

Hosted model APIs with autoscaling on Deep Infra's own inference infrastructure.

Drop-in OpenAI replacement - swap base URL, keep existing code
100+ models including the DeepSeek V4, Qwen 3.7, Llama 4, Claude 5, Gemini 3.5, Gemma 4, GLM-5, Kimi K2.7, and Nemotron 3 families

Dedicated GPU Instances

On-demand GPU nodes with SSH access for custom workloads.

GPU Clusters

Multi-node B200 and B300 clusters with SSH access for training and full-control workloads.

Rent a B200 or B300 cluster and run arbitrary workloads
On-demand DGX B300 configurations billed per instance-hour

Together AI

Pricing Options

Deep Infra

Serverless pay-per-token

OpenAI-compatible inference APIs billed per input and output token, with no idle GPU time or minimums

Dedicated GPU hourly rates

Published transparent hourly pricing for A100, H100, H200, B200, and B300 GPUs with pay-as-you-go billing

Per-execution-time billing

Non-LLM models are billed for inference execution time rather than per token

Cached input pricing

Prompt-cached input tokens are billed at a lower rate than uncached input tokens

No long-term commitments

Flexible hourly billing for dedicated instances with no prepayments, contracts, or minimums required

Together AI

Serverless pay-per-token

Per-token pricing scales based on model size, from small open-source models to 405B parameter frontier models

Batch API

50% discount for non-urgent inference workloads

Provisioned Throughput

Reserve dedicated capacity priced in throughput units (PTUs) with guaranteed SLAs

Fine-tuning

Per-token pricing for LoRA and full fine-tuning based on model size and dataset

GPU Clusters - On-demand

Hourly GPU pricing for instant self-service clusters

GPU Clusters - Reserved

Custom pricing for reserved capacity with significant discounts for longer commitments

Dedicated Inference

Single-tenant GPU instances with guaranteed performance

Getting Started

Deep Infra

Get Started

1
Create an account
Sign up (GitHub-supported) and open the Deep Infra dashboard
2
Enable billing
Add a payment method to unlock GPU rentals and API usage
3
Pick a GPU option
Choose serverless APIs or dedicated A100, H100, H200, B200, or B300 instances
4
Launch and connect
Start instances with SSH access or call the OpenAI-compatible API endpoints
5
Monitor usage
Track spend and instance status from the dashboard and shut down when idle

Together AI

Get Started

1
Create an account
Sign up at together.ai
2
Get API key
Generate an API key from your dashboard
3
Choose a model
Browse 100+ models for chat, code, images, video, and audio
4
Make API calls
Use OpenAI-compatible endpoints or Together SDK

Support & Global Availability

Deep Infra

Global Regions

Runs on self-operated, inference-optimized infrastructure in US-based data centers; no international region list is published.

Support

Documentation site, dashboard guidance, Discord community, feedback email (feedback@deepinfra.com), and contact-sales options.

Together AI

Global Regions

Global data center network across 25+ cities with frontier hardware including GB300, GB200, B200, H200, H100

Support

Documentation, community Discord, email support, and expert support for reserved cluster customers