mirror of
https://github.com/n8n-io/n8n.git
synced 2026-10-19 16:55:02 +02:00
d3bc90a777
Correlate tool_result events back to their tool_use by id and record every
is_error result as {tool, message} (message truncated to 500 chars; string
and text-block-array contents both handled). The failure list rides next to
toolCalls through the whole spend pipeline: buildToolErrorsPerRun per case
and per-tool error counts in summary.mcpBuild.toolErrors in
eval-results.json, a build_tool_errors count as LangSmith row feedback plus
per-tool totals in experiment metadata, and per-build lists + totals in the
manifest builder's stats sidecar. Timed-out builds keep contributing the
errors their partial stream recorded.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GA23ytEUfHpzkv7meRdVAJ
|
||
|---|---|---|
| .. | ||
| aggregator.ts | ||
| build-orchestrator.ts | ||
| case-pipeline.ts | ||
| case-selection.ts | ||
| ci-metadata.ts | ||
| direct-driver.ts | ||
| eval-session.ts | ||
| iterations.ts | ||
| lane-allocator.ts | ||
| lane-setup.ts | ||
| langsmith-driver.ts | ||
| persist.ts | ||
| reporters.ts | ||
| reshape.ts | ||
| rows.ts | ||
| tiers.ts | ||