github-mirror/n8n
1
0
Fork 0
mirror of https://github.com/n8n-io/n8n.git synced 2026-07-28 03:24:59 +02:00
Code Issues Actions 13 Packages Projects Releases Wiki Activity Graph
22,308 Commits 1,562 Branches 2,089 Tags 2.4 GiB
subworkflow-progress
Commit Graph

196 Commits

Author SHA1 Message Date
José Braulio González Valido
b0a10229a0
refactor(ai-builder): Split the eval harness runner into domain modules (no-changelog) (#34834) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-27 09:01:09 +00:00
Anne Aguirre
decb3228c5
feat(ai-builder): Tidy up tool names and agent builder tool UX (#34646)
Some checks failed
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (24.18.0) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Details
Build: Benchmark Image / build (push) Has been cancelled
Details
Util: Sync API Docs / sync-public-api (push) Has been cancelled
Details
2026-07-24 15:26:08 +00:00
José Braulio González Valido
cbe5710c4c
feat(ai-builder): Report per-case claude build cost for MCP eval builds (no-changelog) (#34777) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-23 18:42:09 +00:00
José Braulio González Valido
b93a99945b
feat(ai-builder): Harden the eval harness — crash-recovery journal, parity fixes, extension points (no-changelog) (#34747) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-23 12:25:55 +00:00
José Braulio González Valido
3f63b73d38
fix(ai-builder): Scope user-proxy decisions to the conversation moment (no-changelog) (#34719) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-23 00:04:17 +00:00
José Braulio González Valido
ce6416fe04
docs(ai-builder): Add a source-linking provenance step to the eval-authoring skill (no-changelog) (#34721)
Some checks are pending
Build: Benchmark Image / build (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (24.18.0) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Details
Util: Sync API Docs / sync-public-api (push) Waiting to run
Details 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-22 22:35:13 +00:00
José Braulio González Valido
463d50b1bd
refactor(ai-builder): Decompose the eval CLI into phase modules with typed seams (no-changelog) (#34691) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-22 16:25:44 +00:00
Riqwan Thamir
c0fe8ba4db
feat(editor): Track Instance AI entry point as action_source on builder messages (#34671) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-22 13:24:29 +00:00
José Braulio González Valido
5a1aa3feef
fix(ai-builder): Detect datasets changes when re-pushing eval cases to LangTracer (no-changelog) (#34658) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-22 11:55:48 +00:00
José Braulio González Valido
ee46e64d50
chore(ai-builder): Typecheck the eval harness and pin its external contracts (no-changelog) (#34673) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-22 08:18:41 +00:00
José Braulio González Valido
5fd800de20
feat(ai-builder): Support execution scenarios for first-class agents in evals (#34384)
Some checks failed
Build: Benchmark Image / build (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (24.18.0) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Details
Util: Sync API Docs / sync-public-api (push) Waiting to run
Details
Test: E2E Performance / prepare-docker (push) Has been cancelled
Details
Release: Storybook / Cloudflare Pages (push) Has been cancelled
Details
Test: E2E Performance / build-and-test-performance (push) Has been cancelled
Details
Test: E2E Performance / Canvas Perf Sentinels (push) Has been cancelled
Details 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-21 13:54:06 +00:00
José Braulio González Valido
32d4c1a123
ci(ai-builder): Point eval workflows at the consolidated LangTracer baseline suite (no-changelog) (#34402) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-20 13:55:41 +00:00
Mutasem Aldmour
02af123574
feat: Add typed seed data tables with rows on execution scenarios (#34420) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 17:30:19 +00:00
Mutasem Aldmour
7d6fd4ca9c
fix: Report an unverifiable unit as notVerified, not a silent pass (#34421) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 14:23:10 +00:00
Mutasem Aldmour
40c5b76708
fix: Do not lose scenario results on a budget/timeout abort (#34419) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 11:15:28 +00:00
José Braulio González Valido
3f7258b1a4
test(ai-builder): Prune the stored-key eval case carve-out (no-changelog) (#34248)
Some checks are pending
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (24.16.0) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Details 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-16 21:24:40 +00:00
oleg
97446258af
feat(editor): Collapse AI Assistant thinking traces into thinking blocks (#34274) 
Signed-off-by: Oleg Ivaniv <me@olegivaniv.com>
 2026-07-16 08:56:19 +00:00
Robin Braumann
cf5ea8e173
fix(core): Make the AI Assistant agent-aware — intent gate, multi-agent sessions, builder session cleanup (no-changelog) (#34200) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-15 13:00:10 +00:00
Arvin A
38894a067a
feat(core): Add config-evals skill for Instance AI eval creation (no-changelog) (#34082) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-15 12:49:31 +00:00
Benjamin Schroth
d6dcf3b749
test(ai-builder): Support evals for agent building and for config evals (no-changelog) (#33888) 
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
 2026-07-15 12:34:21 +00:00
José Braulio González Valido
9a48bc5fa7
fix(ai-builder): Honor eq @version conditions in generated node type definitions (#34232) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-15 12:32:00 +00:00
José Braulio González Valido
ced861603b
test(ai-builder): Move the workflow-eval case corpus to LangTracer (no-changelog) (#33983) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-15 08:58:49 +00:00
Mutasem Aldmour
199584aab0
fix(core): Correct OpenAI mock response shapes in eval simulation (no-changelog) (#34140) 
Co-authored-by: Jose <jose.gonzalez@n8n.io>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-15 07:49:16 +00:00
Robin Braumann
fd13039be2
feat(core): Cascade builder sub-agent questions into the AI assistant chat (no-changelog) (#34086) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-14 14:22:03 +00:00
José Braulio González Valido
2233d720ae
ci: Bound and instrument Instance AI eval lane containers (no-changelog) (#33903) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-14 09:28:46 +00:00
Filipe Tavares
67b3ed11fe
feat(editor): Start Instance AI threads from templates on the website and template page (#33653) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-13 15:41:54 +00:00
Robin Braumann
f1d156b6cd
feat(core): Route AI assistant agent building through a builder sub-agent (no-changelog) (#34056) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-13 14:52:08 +00:00
Robin Braumann
dc5cc1434e
chore(core): Remove the assistant's embedded agent-builder toolset (no-changelog) (#34066) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-13 14:20:13 +00:00
Michael Kret
b60aafc809
feat(core): Make Instance AI aware of n8n Connect (#33524) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-07-13 11:14:07 +00:00
Robin Braumann
f40e8e6efd
feat(core): Align Instance AI intent recognition and evals with the anchor + embeds_other taxonomy (no-changelog) (#33843) 
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: José Braulio González Valido <jose.gonzalez@n8n.io>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-13 08:16:46 +00:00
José Braulio González Valido
3bc2292c78
test(ai-builder): Treat answer-only cases as valid without a built workflow (no-changelog) (#33942)
Some checks are pending
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (24.16.0) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Details 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-10 21:54:14 +00:00
José Braulio González Valido
13c95f2c05
fix(ai-builder): Eliminate non-builder noise families in workflow evals (no-changelog) (#33944) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-10 13:25:29 +00:00
José Braulio González Valido
7dd065a77b
feat(ai-builder): Scale eval budgets by case complexity and bound the heaviest prompts (no-changelog) (#33950) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-10 12:58:17 +00:00
José Braulio González Valido
1d61db2252
test(ai-builder): Rename response-matches eval check and fix multi-turn wiring (no-changelog) (#32810) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-10 12:58:13 +00:00
José Braulio González Valido
8e6018b0a5
fix(ai-builder): Return experimentUrl from the empty-selection eval early exit (no-changelog) (#33947) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-10 12:50:43 +00:00
José Braulio González Valido
35632ce3ab
fix(ai-builder): Sync execution scenarios on lang-tracer push updates (no-changelog) (#33841) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-10 12:50:12 +00:00
Riqwan Thamir
345b7aaabe
perf(core): Reduce Instance AI initial tool context (no-changelog) (#33815) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-10 07:59:35 +00:00
José Braulio González Valido
a88231544a
feat(ai-builder): Persist eval expectation verdicts to LangSmith run outputs (no-changelog) (#33788) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-09 22:21:46 +00:00
Arvin A
e6dee743e6
test(ai-builder): Add advanced user-behavior multi-turn eval cases (no-changelog) (#31758) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: José Braulio González Valido <jose.gonzalez@n8n.io>
Co-authored-by: José Braulio González Valido <josebragv@gmail.com>
 2026-07-09 18:13:42 +00:00
Jaakko Husso
4dd369991f
feat(core): Use a shared per-thread event sequence for Instance AI multi-main (no-changelog) (#33558) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-09 07:44:20 +00:00
oleg
a1df115aef
fix(core): Report auto-bound credentials from AI Assistant workflow builds (#33802) 2026-07-08 13:01:29 +00:00
oleg
2d42b3fecf
fix(core): Reconcile stale AI Assistant mocked-credential simulation plan before workflow verification (#33808) 2026-07-08 13:01:08 +00:00
Anne Aguirre
5c6544af4a
feat(core): Port agent builder skills and tools to Instance AI (no-changelog) (#33384) 
Co-authored-by: Robin Braumann <robin.braumann@n8n.io>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: bjorger <50590409+bjorger@users.noreply.github.com>
Co-authored-by: Michael Drury <michael.drury@n8n.io>
Co-authored-by: Michael Drury <me@michaeldrury.co.uk>
 2026-07-08 12:41:12 +00:00
oleg
43aa066803
fix(core): Use correct Gmail OAuth2 credential type in eval credential seeder (no-changelog) (#33825) 2026-07-08 12:34:09 +00:00
Mutasem Aldmour
c79184b5a5
feat(core): Add eval:langtracer-push to push eval cases to a suite (no-changelog) (#33781) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-08 07:52:23 +00:00
Benjamin Schroth
48e7900db0
test(ai-builder): Add eval cases for evaluation generation (#33719)
Some checks are pending
Build: Benchmark Image / build (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Unit tests (24.16.0) (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
Details
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Details
Util: Sync API Docs / sync-public-api (push) Waiting to run
Details
2026-07-07 15:29:42 +00:00
Albert Alises
e83512dfd8
test(core): Add Instance AI eval cases for recently merged builder changes (no-changelog) (#33763) 2026-07-07 14:12:08 +00:00
Robin Braumann
f25699fe2c
test(core): Extend Instance AI intent eval fixtures (no-changelog) (#33224) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-07 12:49:32 +00:00
Riqwan Thamir
0775ea114a
refactor(core): Remove Instance AI orchestration delegate tool (no-changelog) (#33556) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-07 09:15:26 +00:00
José Braulio González Valido
a89f85b052
fix(ai-builder): Make eval verifier resilient to stalls and exclude no-verdict runs from scoring (no-changelog) (#33562) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-07 08:29:53 +00:00