Qwen3 Reranker 8B is a reranking model from Alibaba's Qwen3 family, used to reorder candidate documents by relevance to a query in search and RAG pipelines.
| Provider | Input / 1M | Output / 1M |
|---|---|---|
| $0.200 | $0.0000 |
Prices updated daily. Last check: Sep 6, 2026
Input, output, and batch rates, plus alternatives, for one provider at a time.
Qwen3 Reranker 8B fits the second stage of a retrieval pipeline: after a vector database or keyword index returns a broad candidate set, the reranker reorders a shortlist so the most relevant passages land at the top. This matters most where the number of documents you can pass to a downstream LLM is limited — enterprise document search, customer support knowledge bases, code search, legal and compliance retrieval, and RAG chatbots where a single wrong passage produces a wrong answer. The 8B size is a reasonable choice when relevance quality is worth the extra compute, such as offline evaluation, batch reindexing, or user-facing search where you rerank only a small top-k. For very high query volumes or strict latency budgets, a smaller reranker in the same series, or reranking fewer candidates, is usually the better trade-off.
Pricing varies by inference provider and by pricing model — some bill per million tokens processed, others per request or per GPU-hour if you self-host the open weights. Because rates change frequently and differ between hosts, check the pricing table on this page for current figures rather than relying on a fixed number.
It is best used as a second-stage reranker in search and retrieval-augmented generation systems. You retrieve a candidate set cheaply with embeddings or keyword search, then use the reranker to reorder the top results so that the most relevant passages are what your application or downstream LLM actually sees.
No. It is a reranker, not a generative chat model. It scores how relevant a document is to a query and does not produce conversational responses. If you need text generation, use a Qwen3 chat model and keep the reranker in the retrieval layer.
Embedding models encode queries and documents into vectors independently, which allows precomputed indexes and very fast approximate search across millions of items. A reranker scores the query and document together, which is more accurate but too expensive to run across an entire corpus. The two are complementary: embeddings retrieve, the reranker refines.
The 8B model is the larger option in the Qwen3 reranker line and generally trades higher compute and latency for better relevance discrimination. Choose it when quality on a small top-k shortlist matters most; choose a smaller variant when you are reranking many candidates per query, serving high traffic, or operating under tight latency limits.