Groq
The fastest AI inference
Last reviewed Mar 14, 2026
Groq provides ultra-fast LLM inference powered by their custom LPU (Language Processing Unit) hardware, offering the fastest token generation speeds in the industry.
LLM API Pricing
Pay-per-token pricing. Prices shown per 1M tokens.
Prices last updated: July 26, 2026
| Model | Input/1M | Output/1M |
|---|---|---|
| $0.040/min | - | |
| $0.050 | $0.080 | |
| $0.075 | $0.300 | |
| $0.150 | $0.600 | |
| $0.590 | $0.790 | |
| $0.600 | $3.00 |
Pros & Cons
Advantages
- Fastest inference speeds in the industry (500+ tokens/second)
- OpenAI-compatible API for easy integration
- Competitive pricing for open-source models
- Free tier available for testing
Limitations
- Limited model selection compared to larger providers
- Focus on inference only - no training capabilities
- Newer platform with less ecosystem maturity
Key Features
LPU-Powered Inference
Custom Language Processing Units deliver industry-leading inference speeds
OpenAI-Compatible API
Drop-in replacement for OpenAI API with minimal code changes
Free Tier Available
Generous free tier for experimentation and small projects
Ultra-Low Latency
Sub-second time-to-first-token for interactive applications
Pricing Options
| Option | Details |
|---|---|
| Pay-per-token | Simple token-based pricing with separate input/output rates |
| Free tier | Rate-limited free access for development and testing |
Availability & Support
Regions
Global availability via cloud infrastructure
Support
Documentation, Discord community, email support
Getting Started
- 1
Create an account
Sign up at console.groq.com with email or OAuth
- 2
Get API key
Generate an API key from the console dashboard
- 3
Make API calls
Use the OpenAI-compatible endpoint with your preferred model
Compare Providers
Find the best prices for the same GPUs and models from other providers