FlashRank
RAG & Memory · Free
Ultra-lite cross-encoder reranking for RAG
At a glance
- Open source
- Apache
- GitHub
- 1,008 stars · Apache-2.0
What is FlashRank?
FlashRank is an ultra-lightweight, fast Python library that adds re-ranking to existing search and retrieval pipelines. It supports cross-encoder-based Pairwise/Pointwise rerankers and LLM-based Listwise rerankers. It runs on CPU without Torch or Transformers and uses a default model of about 4MB. It is presented as having a small package that can reduce per-call cost and cold-start time in serverless deployments such as Lambda.
- Cross-encoder-based Pairwise/Pointwise reranker (up to 512 tokens)
- LLM-based Listwise reranker (up to 8192 tokens)
- No Torch or Transformers required; runs on CPU
- Ultra-small default re-ranking model of about 4MB
- Small package shortens cold starts in serverless deployments
- Choice of several models (ms-marco-MiniLM-L-12-v2, rank-T5-flan, etc.)
Who uses FlashRank and for what
- Re-rank results in existing search and RAG pipelines before passing them to an LLM
- Low-cost re-ranking in serverless environments such as Lambda
Pricing
Open source + paid cloud-managed plans
Open-source libraries are free, managed vector DB/memory services are paid based on usage
Estimate based on AI knowledge - please verify on the official site
AI tools similar to FlashRank (alternatives)
FlashRank vs. alternatives at a glance
| AI | Pricing | Combos on the map | Connected tools | Free | Cheapest monthly | Korean |
|---|---|---|---|---|---|---|
| FlashRank | Free | 0 | 4 | — | — | — |
| BGE Reranker | Free | 0 | 4 | — | — | No |
| Cohere Rerank 3 | Free + paid | 10 | 4 | Yes | — | Yes |
| ColBERT | Free | 0 | 4 | — | — | — |
| Jina Reranker | Free + paid | 0 | 4 | Yes | — | Yes |
2 of these 5 tools have a free plan.
Combo and connection counts are based on the relationships recorded on AI Galaxy Map (2026-10-26); they are not a quality ranking.
FlashRank on AI Galaxy Map
- One of 21 AI tools in the RAG & Memory field.
- Connected to 4 other tools — #7 in its field.
Frequently asked questions
Can I use FlashRank for free?
Open source + paid cloud-managed plans. Prices can change, so check the official site before paying.
What AI can I use instead of FlashRank?
Tools that do the same job, such as BGE Reranker, Cohere Rerank 3, ColBERT, Jina Reranker, are connected to it on the map.
Sources (official pages)
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying.