Commit Graph

180 Commits

Author SHA1 Message Date
oleg
97446258af
feat(editor): Collapse AI Assistant thinking traces into thinking blocks (#34274)
Signed-off-by: Oleg Ivaniv <me@olegivaniv.com>
2026-07-16 08:56:19 +00:00
Robin Braumann
cf5ea8e173
fix(core): Make the AI Assistant agent-aware — intent gate, multi-agent sessions, builder session cleanup (no-changelog) (#34200)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-15 13:00:10 +00:00
Arvin A
38894a067a
feat(core): Add config-evals skill for Instance AI eval creation (no-changelog) (#34082)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-15 12:49:31 +00:00
Benjamin Schroth
d6dcf3b749
test(ai-builder): Support evals for agent building and for config evals (no-changelog) (#33888)
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
2026-07-15 12:34:21 +00:00
José Braulio González Valido
9a48bc5fa7
fix(ai-builder): Honor eq @version conditions in generated node type definitions (#34232)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 12:32:00 +00:00
José Braulio González Valido
ced861603b
test(ai-builder): Move the workflow-eval case corpus to LangTracer (no-changelog) (#33983)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 08:58:49 +00:00
Mutasem Aldmour
199584aab0
fix(core): Correct OpenAI mock response shapes in eval simulation (no-changelog) (#34140)
Co-authored-by: Jose <jose.gonzalez@n8n.io>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 07:49:16 +00:00
Robin Braumann
fd13039be2
feat(core): Cascade builder sub-agent questions into the AI assistant chat (no-changelog) (#34086)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-14 14:22:03 +00:00
José Braulio González Valido
2233d720ae
ci: Bound and instrument Instance AI eval lane containers (no-changelog) (#33903)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 09:28:46 +00:00
Filipe Tavares
67b3ed11fe
feat(editor): Start Instance AI threads from templates on the website and template page (#33653)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-13 15:41:54 +00:00
Robin Braumann
f1d156b6cd
feat(core): Route AI assistant agent building through a builder sub-agent (no-changelog) (#34056)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-13 14:52:08 +00:00
Robin Braumann
dc5cc1434e
chore(core): Remove the assistant's embedded agent-builder toolset (no-changelog) (#34066)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-13 14:20:13 +00:00
Michael Kret
b60aafc809
feat(core): Make Instance AI aware of n8n Connect (#33524)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-07-13 11:14:07 +00:00
Robin Braumann
f40e8e6efd
feat(core): Align Instance AI intent recognition and evals with the anchor + embeds_other taxonomy (no-changelog) (#33843)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: José Braulio González Valido <jose.gonzalez@n8n.io>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-13 08:16:46 +00:00
José Braulio González Valido
3bc2292c78
test(ai-builder): Treat answer-only cases as valid without a built workflow (no-changelog) (#33942)
Some checks are pending
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (24.16.0) (push) Waiting to run
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-10 21:54:14 +00:00
José Braulio González Valido
13c95f2c05
fix(ai-builder): Eliminate non-builder noise families in workflow evals (no-changelog) (#33944)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-10 13:25:29 +00:00
José Braulio González Valido
7dd065a77b
feat(ai-builder): Scale eval budgets by case complexity and bound the heaviest prompts (no-changelog) (#33950)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-10 12:58:17 +00:00
José Braulio González Valido
1d61db2252
test(ai-builder): Rename response-matches eval check and fix multi-turn wiring (no-changelog) (#32810)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-10 12:58:13 +00:00
José Braulio González Valido
8e6018b0a5
fix(ai-builder): Return experimentUrl from the empty-selection eval early exit (no-changelog) (#33947)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-10 12:50:43 +00:00
José Braulio González Valido
35632ce3ab
fix(ai-builder): Sync execution scenarios on lang-tracer push updates (no-changelog) (#33841)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-10 12:50:12 +00:00
Riqwan Thamir
345b7aaabe
perf(core): Reduce Instance AI initial tool context (no-changelog) (#33815)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-10 07:59:35 +00:00
José Braulio González Valido
a88231544a
feat(ai-builder): Persist eval expectation verdicts to LangSmith run outputs (no-changelog) (#33788)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-09 22:21:46 +00:00
Arvin A
e6dee743e6
test(ai-builder): Add advanced user-behavior multi-turn eval cases (no-changelog) (#31758)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: José Braulio González Valido <jose.gonzalez@n8n.io>
Co-authored-by: José Braulio González Valido <josebragv@gmail.com>
2026-07-09 18:13:42 +00:00
Jaakko Husso
4dd369991f
feat(core): Use a shared per-thread event sequence for Instance AI multi-main (no-changelog) (#33558)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-09 07:44:20 +00:00
oleg
a1df115aef
fix(core): Report auto-bound credentials from AI Assistant workflow builds (#33802) 2026-07-08 13:01:29 +00:00
oleg
2d42b3fecf
fix(core): Reconcile stale AI Assistant mocked-credential simulation plan before workflow verification (#33808) 2026-07-08 13:01:08 +00:00
Anne Aguirre
5c6544af4a
feat(core): Port agent builder skills and tools to Instance AI (no-changelog) (#33384)
Co-authored-by: Robin Braumann <robin.braumann@n8n.io>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: bjorger <50590409+bjorger@users.noreply.github.com>
Co-authored-by: Michael Drury <michael.drury@n8n.io>
Co-authored-by: Michael Drury <me@michaeldrury.co.uk>
2026-07-08 12:41:12 +00:00
oleg
43aa066803
fix(core): Use correct Gmail OAuth2 credential type in eval credential seeder (no-changelog) (#33825) 2026-07-08 12:34:09 +00:00
Mutasem Aldmour
c79184b5a5
feat(core): Add eval:langtracer-push to push eval cases to a suite (no-changelog) (#33781)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-08 07:52:23 +00:00
Benjamin Schroth
48e7900db0
test(ai-builder): Add eval cases for evaluation generation (#33719)
Some checks are pending
Build: Benchmark Image / build (push) Waiting to run
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (24.16.0) (push) Waiting to run
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Util: Sync API Docs / sync-public-api (push) Waiting to run
2026-07-07 15:29:42 +00:00
Albert Alises
e83512dfd8
test(core): Add Instance AI eval cases for recently merged builder changes (no-changelog) (#33763) 2026-07-07 14:12:08 +00:00
Robin Braumann
f25699fe2c
test(core): Extend Instance AI intent eval fixtures (no-changelog) (#33224)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-07 12:49:32 +00:00
Riqwan Thamir
0775ea114a
refactor(core): Remove Instance AI orchestration delegate tool (no-changelog) (#33556)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-07 09:15:26 +00:00
José Braulio González Valido
a89f85b052
fix(ai-builder): Make eval verifier resilient to stalls and exclude no-verdict runs from scoring (no-changelog) (#33562)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-07 08:29:53 +00:00
Albert Alises
3aa3ffd13b
fix(core): Report node errors in workflow verification (#33576) 2026-07-07 08:21:38 +00:00
Riqwan Thamir
d21a499462
test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-07 07:26:51 +00:00
José Braulio González Valido
eb59191076
feat(ai-builder): Capture compiled workflow JSON as a trace event for eval seed reconstruction (no-changelog) (#33302)
Some checks are pending
Build: Benchmark Image / build (push) Waiting to run
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (24.16.0) (push) Waiting to run
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Util: Sync API Docs / sync-public-api (push) Waiting to run
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-06 15:03:38 +00:00
Milorad FIlipović
c5d65998da
test: Reduce non-builder noise in MCP workflow evals (no-changelog) (#33565) 2026-07-06 13:48:11 +00:00
José Braulio González Valido
7fc1e4e791
fix(ai-builder): Track consolidated-tool data table creations for eval cleanup (no-changelog) (#33580)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-06 09:51:36 +00:00
José Braulio González Valido
4d11639cf1
test(ai-builder): Add plan-rejection eval and harden multi-turn eval consistency (no-changelog) (#33433)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-06 06:11:22 +00:00
Albert Alises
2be4092c4d
fix(core): Improve Instance AI workflow-building reliability (#33530) 2026-07-03 13:27:45 +00:00
Milorad FIlipović
579656db2e
test: Parallelize MCP workflow evals across build lanes (no-changelog) (#33468) 2026-07-03 08:33:42 +00:00
José Braulio González Valido
a8f1b2c1b8
ci: Scope Instance AI evals dispatcher to PR gating (no-changelog) (#33499)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-03 07:29:09 +00:00
José Braulio González Valido
b3497f0076
docs(ai-builder): Expand the create-instance-ai-eval skill (no-changelog) (#33407)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-02 13:01:56 +00:00
oleg
6f0d30fbb1
fix: Improve AI Assistant post-build follow-ups (#33419) 2026-07-02 11:34:21 +00:00
Milorad FIlipović
3f3b3a756c
fix(core): Harden MCP eval execution against transient network errors (no-changelog) (#33398) 2026-07-02 08:51:49 +00:00
Albert Alises
4192c9554e
feat(core): Prefer predefined credentials over generic auth on HTTP Request nodes (#33298) 2026-07-02 07:50:49 +00:00
José Braulio González Valido
dbadc276a2
test(ai-builder): Pin eval experiments to the Staging LangSmith workspace (no-changelog) (#33397)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-02 07:17:26 +00:00
José Braulio González Valido
2ad33a1303
fix(ai-builder): Fix AI-node eval mock-execution timeouts (no-changelog) (#33323)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-01 08:33:51 +00:00
Tomi Turtiainen
7fb04cdb98
refactor: Remove @n8n/utils barrel export (no-changelog) (#33082) 2026-06-30 16:05:24 +03:00