AgentOps
Observability & Evals · Free + paid
Observability and debugging platform purpose-built for AI agents
At a glance
- Made by
- AgentOps
- Korean
- None (English and a few others only)
- API
- Yes
- Available on
- Web, API
- Open source
- MIT
- GitHub
- 5,883 stars · MIT
What is AgentOps?
AgentOps is a developer platform for testing, debugging, and deploying AI agents and LLM apps, helping developers build, evaluate, and monitor agents. With two lines of code, it automatically records events such as LLM calls, tools, and multi-agent interactions, and shows them by session on a dashboard. It integrates with more than 400 LLMs and frameworks including OpenAI, CrewAI, and Autogen, and tracks token counts and costs. The app is open source under the MIT license and also provides self-hosting guidance.
- Visualization of LLM calls·tools·multi-agent interactions
- Time-travel debugging that rewinds and replays agent runs
- Logs·errors·prompt injection attack records (debug·audit)
- Token count tracking and cost tracking for more than 400 LLMs
- Fine-tune specialized LLMs with saved responses (up to 25x cheaper)
- Python·TypeScript SDKs and integration with major agent frameworks
- Public API and MCP server
- Self-hosting (Docker, etc.)
Who uses AgentOps and for what
- Developers evaluate and monitor AI agents from prototype to production
- Tracking spending across multiple agents
Pricing
What you get for free — Yes (Basic $0/month, free up to 5,000 events)
| Plan | Price | Main limits |
|---|---|---|
| Basic | $0/mo | Up to 5,000 events |
| Pro | $40/mo | From $40/month, pay-as-you-go (pricing calculator); unlimited event·log retention, export, role permissions |
| Enterprise | Contact sales | Custom pricing; SLA, SSO, on-premises·self-hosting, SOC-2·HIPAA |
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying. · Official pricing page
AI tools similar to AgentOps (alternatives)
AgentOps vs. alternatives at a glance
| AI | Pricing | Combos on the map | Connected tools | Free | Cheapest monthly | Korean |
|---|---|---|---|---|---|---|
| AgentOps | Free + paid | 0 | 5 | Yes | $40/mo | No |
| Helicone | Free | 0 | 5 | Yes | $79/mo | No |
| Langfuse | Free | 0 | 5 | Yes | $29/mo | No |
| Opik | Free | 0 | 5 | Yes | $19/mo | No |
| Phoenix (Arize) | Free | 0 | 5 | Yes | $50/mo | No |
5 of these 5 tools have a free plan. Cheapest paid plan: Opik ($19/mo).
Combo and connection counts are based on the relationships recorded on AI Galaxy Map (2026-10-26); they are not a quality ranking.
AgentOps on AI Galaxy Map
- One of 27 AI tools in the Observability & Evals field.
- Connected to 5 other tools — #6 in its field.
Frequently asked questions
Can I use AgentOps for free?
Yes (Basic $0/month, free up to 5,000 events). Prices can change, so check the official site before paying.
What AI can I use instead of AgentOps?
Tools that do the same job, such as Helicone, Langfuse, Opik, Phoenix (Arize), are connected to it on the map.
Can I use AgentOps in Korean?
None (English and a few others only)
Sources (official pages)
- https://github.com/AgentOps-AI/agentops
- https://www.agentops.ai/
- https://docs.agentops.ai/v2/introduction
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying.