Groq vs Lyceum

Custom Language Processing Units run inference, with 256 LPUs and 128 GB of on-chip SRAM per rack

Drop-in replacement for the OpenAI API at api.groq.com/openai/v1, including a Responses API

GroqMetal bare-metal infrastructure, GroqCore inference stack, and GroqAssured enterprise governance, each including the layers below

Text generation plus speech-to-text, text-to-speech, OCR and image recognition, and content moderation models

Compound systems that combine models with web search, code execution, remote MCP tools, and Google Workspace connectors

Performance, flex, and batch processing tiers, plus prompt caching, structured outputs, and LoRA inference

API access to open-source models with pay-per-token pricing.

Reserved GPU capacity for production models ensuring low latency and high availability.

Run training jobs on GPUs without the need for infrastructure management.

Full root access to customizable GPU instances ready in seconds.

Support for configurations from 8 to 8,000 GPUs with InfiniBand connectivity.