AI Testing & Debugging

LLM engineering platform for gateway routing, observability, evaluations, and prompt optimization

Mac tool that turns screenshots into JSON readable by CLI agents

Automated bug tracking, error monitoring, and contextual reporting platform for modern web applications

Expect lets agents test code in a real browser by scanning diffs, generating plans, and running execution workflows from one command

TestSprite is an AI testing agent that can plan, write, execute, debug, and report software tests end to end

Ogoron is an automated testing platform where autonomous agents plan, generate, and maintain tests directly from your codebase

QA.tech uses AI agents to explore web apps, generate complete test suites, and run QA checks on release, schedule, or manual triggers

End-to-end testing and observability for conversational AI. Run pre-production simulations and monitor production conversations for voice and chat agents

Glassbrain helps teams visually debug LLM apps by capturing every OpenAI, Anthropic, and LangChain call and replaying failed runs

Future AGI helps teams build, evaluate, optimize, and monitor LLM and AI agent applications with multimodal quality testing and observability

Evaluation and testing platform for LLM apps and AI agents

LLM-Citeops is a Node.js CLI that audits AEO and GEO readiness, exports reports, and supports CI score thresholds

Waydev is an engineering analytics platform for measuring delivery performance, DORA metrics, and productivity trends

Simple, open-source LLM tracing for AI agents. Track prompts, completions, latency, token usage, and cost

Render AI chat data and Codex logs into filterable browser timelines

Regression testing and semantic diff platform for agent apps to catch behavior changes before release

Open-source debugging and run-inspection tool for AI agent workflows, prompts, tool calls, and runtime state

OpenAI-compatible AI forecasting API that returns calibrated probabilities for future events

Open-source agent engineering platform with traces, evals, and metrics for debugging AI agents

AI-assisted release management for release notes, launch checklists, and rollout communication

AI agent that reproduces GitHub issues and returns evidence-backed reports

Debug AI agents by recording, replaying, forking, and sharing runs

Open-source AI agent monitoring and quality platform that detects failure modes and helps developers fix agent issues before production