n8n/packages/@n8n/instance-ai/evaluations/harness
Jaakko Husso 7b10a16ca4
feat(core): Tell Instance AI when a verified draft is not the live workflow (#38289)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-14 13:47:19 +00:00
..
artifacts feat: Export structured agent artifacts in eval results (#38394) 2026-09-11 15:11:02 +00:00
agent-execution.ts feat: Export structured agent artifacts in eval results (#38394) 2026-09-11 15:11:02 +00:00
attribution.ts fix(ai-builder): Keep model-provider outages out of eval builder scores (no-changelog) (#35293) 2026-08-04 10:52:11 +00:00
browser-runtime.ts test(core): Add openai, gemini and slack credential-setup eval fixtures (no-changelog) (#36461) 2026-08-21 06:27:16 +00:00
build-mode.ts feat(core): Add progressive workflow building (no-changelog) (#37996) 2026-09-10 13:42:43 +00:00
build-workflow.ts feat(core): Add progressive workflow building (no-changelog) (#37996) 2026-09-10 13:42:43 +00:00
capture-run-debug.ts build(core): Update Instance AI dependencies (#36635) 2026-08-24 13:35:16 +00:00
chat-loop.ts feat(core): Add progressive workflow building (no-changelog) (#37996) 2026-09-10 13:42:43 +00:00
cleanup.ts fix(core): Keep AI Assistant workflow builds honest about their project (#37177) 2026-08-27 09:40:04 +00:00
conversation-seed.ts chore: Update eslint configuration (#38307) 2026-09-10 14:40:35 +03:00
credential-setup-checks.ts chore: Update eslint configuration (#38307) 2026-09-10 14:40:35 +03:00
credential-setup-lane.ts test(core): Add openai, gemini and slack credential-setup eval fixtures (no-changelog) (#36461) 2026-08-21 06:27:16 +00:00
fixture-server.ts test(core): Add openai, gemini and slack credential-setup eval fixtures (no-changelog) (#36461) 2026-08-21 06:27:16 +00:00
in-memory-event-bus.ts refactor(core): Make the Instance AI durable event log the only storage path (no-changelog) (#36729) 2026-08-28 12:00:45 +00:00
langsmith-seed.ts chore: Update eslint configuration (#38307) 2026-09-10 14:40:35 +03:00
logger.ts feat(ai-builder): Workflow evaluation framework with LLM mock execution (#27818) 2026-04-07 13:31:16 +00:00
normalize-workflow.ts refactor(core): Replace local isRecord and model-id helper copies with shared ones (no-changelog) (#38052) 2026-09-08 12:05:27 +00:00
parse-seed-workflow.ts feat(ai-builder): Add conversation pre-seeding to workflow evals (no-changelog) (#32196) 2026-06-23 17:30:30 +00:00
prebuilt-workflows.ts refactor(ai-builder): Split the eval harness runner into domain modules (no-changelog) (#34834) 2026-07-27 09:01:09 +00:00
prior-runs.ts feat(core): Run seeded workflows before the graded turn in Instance AI evals (no-changelog) (#37516) 2026-09-03 14:09:18 +00:00
redact.ts fix(core): Consolidate secret redaction in @n8n/utils and redact more credential shapes (#38054) 2026-09-09 15:39:44 +00:00
sandbox-config.ts feat(core): Use n8n default sandbox for Instance AI (no-changelog) (#31335) 2026-06-04 08:31:27 +00:00
scenario-execution.ts refactor(core): Import agents types and helpers from @n8n/agents instead of the instance-ai barrel (no-changelog) (#38053) 2026-09-08 12:05:50 +00:00
schema.ts feat(core): Add progressive workflow building (no-changelog) (#37996) 2026-09-10 13:42:43 +00:00
seed-tables.ts feat(core): Add progressive workflow building (no-changelog) (#37996) 2026-09-10 13:42:43 +00:00
stub-services.ts feat(core): Tell Instance AI when a verified draft is not the live workflow (#38289) 2026-09-14 13:47:19 +00:00
stub-workspace.ts test(core): Support tool-result cleanup in the eval stub workspace (no-changelog) (#37202) 2026-08-27 12:47:15 +00:00
transient-error.ts fix(ai-builder): Bound eval lane requests and stop abandoned mocked executions (no-changelog) (#35228) 2026-08-06 08:23:37 +00:00
workflow-context.ts feat(core): Extend evaluations to support node groups (no-changelog) (#35629) 2026-08-19 08:42:53 +00:00