Coding · Advanced
Diagnosing failed tool calls and generating test suites
Audit agent session telemetry, identify failure patterns, and draft regression test cases.
- On a scheduleReview session error logs
- ThenCluster common agent failures
- ResultPropose regression test PR
Analyze agent interaction logs from backend tool servers to discover where autonomous agents encounter errors or unexpected behaviors. The bot clusters similar failure patterns, identifies missing arguments or schema mismatches, and prepares unit and integration test fixtures to catch regressions across model versions.
Prompt to start with
BotBentoRecommended
Read recent agent session logs and tool call traces from the database. Cluster recurring execution errors, schema validation issues, and tool misuse patterns. For each frequent failure mode, draft an automated evaluation test case reflecting the agent's input and intended outcome. Submit new test files or bug reports to GitHub only after user approval.