Promptfoo
Observability & Evals · Free
Test, evaluate, and red-team LLM prompts
At a glance
- Made by
- Promptfoo, Inc. (part of OpenAI)
- Korean
- None (English and a few others only)
- API
- Yes
- Available on
- CLI, Web
- Open source
- MIT
- GitHub
- 25,987 stars · MIT
What is Promptfoo?
promptfoo is a CLI and library for evaluating and red-teaming LLM-based apps. It finds app-specific vulnerabilities with tailored attacks that imitate real users (prompt injection, jailbreaks, personal data leaks, and more). It automatically evaluates prompts, models, and RAG pipelines, compares multiple models side by side, and can be added to CI/CD and PR code scanning. Evaluations run 100% locally, so prompts never leave your machine. According to the official page, Promptfoo has joined OpenAI and will remain MIT open source.
- Automated red teaming for agents and RAG (prompt injection, jailbreaks, PII leaks, and more)
- Automated prompt and model evaluation with side-by-side model comparison
- Automated CI/CD checks and PR code scanning
- Real-time guardrails (defense against jailbreaks and adversarial attacks)
- MCP proxy
- Runs locally (prompts never leave your device)
- Result sharing and vulnerability reports
Who uses Promptfoo and for what
- Developers automatically test prompt and model quality
- Security teams continuously check LLM apps for vulnerabilities
- Industry-specific AI security and compliance testing for finance, insurance, telecom, and more
Pricing
What you get for free — Yes (Community: free forever, open source, 10k red-team probes per month)
| Plan | Price | Main limits |
|---|---|---|
| Community | 0 | Free Forever, all evaluation features, 10k red-team probes per month, local and self-hosted, community support |
| Enterprise | Contact sales | Custom pricing, team collaboration, continuous monitoring, SSO, API access, managed cloud |
| On-Premise | Contact sales | Custom pricing, deployment on your own infrastructure, full data isolation, dedicated engineer |
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying. · Official pricing page
AI tools similar to Promptfoo (alternatives)
Promptfoo vs. alternatives at a glance
| AI | Pricing | Combos on the map | Connected tools | Free | Cheapest monthly | Korean |
|---|---|---|---|---|---|---|
| Promptfoo | Free | 0 | 3 | Yes | — | No |
| Guidance | Free | 0 | 3 | — | — | — |
| PromptLayer | Free + paid | 0 | 3 | Yes | $49/mo | No |
2 of these 3 tools have a free plan. Cheapest paid plan: PromptLayer ($49/mo).
Combo and connection counts are based on the relationships recorded on AI Galaxy Map (2026-10-26); they are not a quality ranking.
Promptfoo on AI Galaxy Map
- One of 27 AI tools in the Observability & Evals field.
- Connected to 3 other tools — #20 in its field.
Frequently asked questions
Can I use Promptfoo for free?
Yes (Community: free forever, open source, 10k red-team probes per month). Prices can change, so check the official site before paying.
What AI can I use instead of Promptfoo?
Tools that do the same job, such as Guidance, PromptLayer, PromptFlow, are connected to it on the map.
Can I use Promptfoo in Korean?
None (English and a few others only)
Sources (official pages)
- https://www.promptfoo.dev/
- https://www.promptfoo.dev/about/
- https://github.com/promptfoo/promptfoo
- https://www.promptfoo.dev/pricing/
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying.