github-mirror/n8n
1
0
Fork 0
mirror of https://github.com/n8n-io/n8n.git synced 2026-10-21 20:20:03 +02:00
Code Issues Actions 18 Packages Projects Releases Wiki Activity Graph
22,726 Commits 229 Branches 2,209 Tags 4.8 GiB
codex/node-panel-refinements
Commit Graph

90 Commits

Author SHA1 Message Date
José Braulio González Valido
1575fce711
fix(ai-builder): Bound eval lane requests and stop abandoned mocked executions (no-changelog) (#35228) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-06 08:23:37 +00:00
José Braulio González Valido
166771c77d
feat(ai-builder): Push a seeded case, and hand the agent its workflow (no-changelog) (#35304) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-05 16:09:01 +00:00
oleg
f9bddc7ff3
fix: Include node behavior flags in instance-ai eval judge context (no-changelog) (#35644) 2026-08-05 14:59:37 +00:00
José Braulio González Valido
7c61f2826a
fix(ai-builder): Give a case's scenario data tables per-run names (no-changelog) (#35543) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-05 12:48:00 +00:00
José Braulio González Valido
d57a81ac60
fix(ai-builder): Keep model-provider outages out of eval builder scores (no-changelog) (#35293) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-04 10:52:11 +00:00
José Braulio González Valido
5d8f2353bf
fix(ai-builder): Give a restored seed workflow a unique name and evict leftovers (no-changelog) (#35299) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-03 17:26:21 +00:00
José Braulio González Valido
e62417356f
feat(ai-builder): Collapse the eval case's three seed keys into one seed union (no-changelog) (#35292) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-03 14:37:06 +00:00
José Braulio González Valido
c6917a194f
fix(ai-builder): Record the served wire envelope in the eval LLM mock ledger (no-changelog) (#34929) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-03 13:16:45 +00:00
Rodrigo Santos da Silva
a25a1ec608
feat: Add manual credential-setup path to instance-ai eval harness (no-changelog) (#35197) 
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
 2026-08-03 09:11:25 +00:00
José Braulio González Valido
be12a4ccdc
feat(ai-builder): Let eval runs exercise the builder's web search (no-changelog) (#35274) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-07-31 07:31:10 +00:00
Mutasem Aldmour
22c8117321
fix(ai-builder): Route eval report artifacts through --output-dir (no-changelog) (#35083) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-07-29 11:04:42 +00:00
José Braulio González Valido
2ae18ad9f6
feat(ai-builder): Validate the eval conversation-seed message envelope (no-changelog) (#35138) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-07-29 08:58:55 +00:00
Luka Zivkovic
650d893151
feat(ai-builder): Emit transcriptPerRun and buildErrorPerRun in eval-results.json (no-changelog) (#35078) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-28 19:25:22 +00:00
José Braulio González Valido
632ef22c0c
feat(ai-builder): Carry an eval case's conversation seed in the case body (no-changelog) (#35074)
Some checks are pending
Build: Benchmark Image / build (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (24.18.0) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Details
Util: Sync API Docs / sync-public-api (push) Waiting to run
Details
2026-07-28 16:26:08 +00:00
José Braulio González Valido
b0a10229a0
refactor(ai-builder): Split the eval harness runner into domain modules (no-changelog) (#34834) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-27 09:01:09 +00:00
José Braulio González Valido
463d50b1bd
refactor(ai-builder): Decompose the eval CLI into phase modules with typed seams (no-changelog) (#34691) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-22 16:25:44 +00:00
José Braulio González Valido
ee46e64d50
chore(ai-builder): Typecheck the eval harness and pin its external contracts (no-changelog) (#34673) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-22 08:18:41 +00:00
José Braulio González Valido
5fd800de20
feat(ai-builder): Support execution scenarios for first-class agents in evals (#34384)
Some checks failed
Build: Benchmark Image / build (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (24.18.0) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Details
Util: Sync API Docs / sync-public-api (push) Waiting to run
Details
Test: E2E Performance / prepare-docker (push) Has been cancelled
Details
Release: Storybook / Cloudflare Pages (push) Has been cancelled
Details
Test: E2E Performance / build-and-test-performance (push) Has been cancelled
Details
Test: E2E Performance / Canvas Perf Sentinels (push) Has been cancelled
Details 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-21 13:54:06 +00:00
Mutasem Aldmour
02af123574
feat: Add typed seed data tables with rows on execution scenarios (#34420) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 17:30:19 +00:00
Mutasem Aldmour
40c5b76708
fix: Do not lose scenario results on a budget/timeout abort (#34419) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 11:15:28 +00:00
oleg
97446258af
feat(editor): Collapse AI Assistant thinking traces into thinking blocks (#34274) 
Signed-off-by: Oleg Ivaniv <me@olegivaniv.com>
 2026-07-16 08:56:19 +00:00
Benjamin Schroth
d6dcf3b749
test(ai-builder): Support evals for agent building and for config evals (no-changelog) (#33888) 
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
 2026-07-15 12:34:21 +00:00
José Braulio González Valido
2233d720ae
ci: Bound and instrument Instance AI eval lane containers (no-changelog) (#33903) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-14 09:28:46 +00:00
Filipe Tavares
67b3ed11fe
feat(editor): Start Instance AI threads from templates on the website and template page (#33653) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-13 15:41:54 +00:00
Robin Braumann
dc5cc1434e
chore(core): Remove the assistant's embedded agent-builder toolset (no-changelog) (#34066) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-13 14:20:13 +00:00
José Braulio González Valido
3bc2292c78
test(ai-builder): Treat answer-only cases as valid without a built workflow (no-changelog) (#33942)
Some checks are pending
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (24.16.0) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Details 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-10 21:54:14 +00:00
José Braulio González Valido
13c95f2c05
fix(ai-builder): Eliminate non-builder noise families in workflow evals (no-changelog) (#33944) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-10 13:25:29 +00:00
José Braulio González Valido
7dd065a77b
feat(ai-builder): Scale eval budgets by case complexity and bound the heaviest prompts (no-changelog) (#33950) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-10 12:58:17 +00:00
José Braulio González Valido
1d61db2252
test(ai-builder): Rename response-matches eval check and fix multi-turn wiring (no-changelog) (#32810) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-10 12:58:13 +00:00
Arvin A
e6dee743e6
test(ai-builder): Add advanced user-behavior multi-turn eval cases (no-changelog) (#31758) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: José Braulio González Valido <jose.gonzalez@n8n.io>
Co-authored-by: José Braulio González Valido <josebragv@gmail.com>
 2026-07-09 18:13:42 +00:00
Jaakko Husso
4dd369991f
feat(core): Use a shared per-thread event sequence for Instance AI multi-main (no-changelog) (#33558) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-09 07:44:20 +00:00
Anne Aguirre
5c6544af4a
feat(core): Port agent builder skills and tools to Instance AI (no-changelog) (#33384) 
Co-authored-by: Robin Braumann <robin.braumann@n8n.io>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: bjorger <50590409+bjorger@users.noreply.github.com>
Co-authored-by: Michael Drury <michael.drury@n8n.io>
Co-authored-by: Michael Drury <me@michaeldrury.co.uk>
 2026-07-08 12:41:12 +00:00
Mutasem Aldmour
c79184b5a5
feat(core): Add eval:langtracer-push to push eval cases to a suite (no-changelog) (#33781) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-08 07:52:23 +00:00
Robin Braumann
f25699fe2c
test(core): Extend Instance AI intent eval fixtures (no-changelog) (#33224) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-07 12:49:32 +00:00
José Braulio González Valido
a89f85b052
fix(ai-builder): Make eval verifier resilient to stalls and exclude no-verdict runs from scoring (no-changelog) (#33562) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-07 08:29:53 +00:00
José Braulio González Valido
eb59191076
feat(ai-builder): Capture compiled workflow JSON as a trace event for eval seed reconstruction (no-changelog) (#33302)
Some checks are pending
Build: Benchmark Image / build (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (24.16.0) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Details
Util: Sync API Docs / sync-public-api (push) Waiting to run
Details 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-06 15:03:38 +00:00
Milorad FIlipović
c5d65998da
test: Reduce non-builder noise in MCP workflow evals (no-changelog) (#33565) 2026-07-06 13:48:11 +00:00
Albert Alises
2be4092c4d
fix(core): Improve Instance AI workflow-building reliability (#33530) 2026-07-03 13:27:45 +00:00
Milorad FIlipović
579656db2e
test: Parallelize MCP workflow evals across build lanes (no-changelog) (#33468) 2026-07-03 08:33:42 +00:00
oleg
6f0d30fbb1
fix: Improve AI Assistant post-build follow-ups (#33419) 2026-07-02 11:34:21 +00:00
Milorad FIlipović
3f3b3a756c
fix(core): Harden MCP eval execution against transient network errors (no-changelog) (#33398) 2026-07-02 08:51:49 +00:00
José Braulio González Valido
dbadc276a2
test(ai-builder): Pin eval experiments to the Staging LangSmith workspace (no-changelog) (#33397) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-02 07:17:26 +00:00
Tomi Turtiainen
7fb04cdb98
refactor: Remove @n8n/utils barrel export (no-changelog) (#33082) 2026-06-30 16:05:24 +03:00
José Braulio González Valido
65f375bbd4
feat(ai-builder): Make eval executionScenarios optional for build-only cases (no-changelog) (#33252) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-30 09:41:14 +00:00
José Braulio González Valido
7ea6900e58
feat(ai-builder): Honor seedThread.liveTurnRunId in eval reconstruction (no-changelog) (#33251) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-30 09:34:10 +00:00
José Braulio González Valido
1d28330d18
feat(ai-builder): Dual-tenant LangSmith reads for Instance AI evals (no-changelog) (#33230) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-29 17:17:14 +00:00
José Braulio González Valido
23d70d1bb9
feat(ai-builder): Source eval test cases from LangTracer (no-changelog) (#33067) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-29 10:17:49 +00:00
José Braulio González Valido
3380ca3790
fix(ai-builder): Reconstruct file-based seeded workflows and judge the whole conversation (no-changelog) (#33048) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-26 10:06:20 +00:00
José Braulio González Valido
974e7be09b
fix(ai-builder): Scope seedThread reconstruction and add per-turn tool counts for the judge (no-changelog) (#32962) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-25 10:56:59 +00:00
Milorad FIlipović
d3dd105aae
feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00