Mutasem Aldmour
|
c79184b5a5
|
feat(core): Add eval:langtracer-push to push eval cases to a suite (no-changelog) (#33781)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-08 07:52:23 +00:00 |
|
Robin Braumann
|
f25699fe2c
|
test(core): Extend Instance AI intent eval fixtures (no-changelog) (#33224)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-07-07 12:49:32 +00:00 |
|
José Braulio González Valido
|
a89f85b052
|
fix(ai-builder): Make eval verifier resilient to stalls and exclude no-verdict runs from scoring (no-changelog) (#33562)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-07 08:29:53 +00:00 |
|
Milorad FIlipović
|
c5d65998da
|
test: Reduce non-builder noise in MCP workflow evals (no-changelog) (#33565)
|
2026-07-06 13:48:11 +00:00 |
|
Albert Alises
|
2be4092c4d
|
fix(core): Improve Instance AI workflow-building reliability (#33530)
|
2026-07-03 13:27:45 +00:00 |
|
Milorad FIlipović
|
579656db2e
|
test: Parallelize MCP workflow evals across build lanes (no-changelog) (#33468)
|
2026-07-03 08:33:42 +00:00 |
|
oleg
|
6f0d30fbb1
|
fix: Improve AI Assistant post-build follow-ups (#33419)
|
2026-07-02 11:34:21 +00:00 |
|
Milorad FIlipović
|
3f3b3a756c
|
fix(core): Harden MCP eval execution against transient network errors (no-changelog) (#33398)
|
2026-07-02 08:51:49 +00:00 |
|
José Braulio González Valido
|
dbadc276a2
|
test(ai-builder): Pin eval experiments to the Staging LangSmith workspace (no-changelog) (#33397)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-02 07:17:26 +00:00 |
|
Tomi Turtiainen
|
7fb04cdb98
|
refactor: Remove @n8n/utils barrel export (no-changelog) (#33082)
|
2026-06-30 16:05:24 +03:00 |
|
José Braulio González Valido
|
65f375bbd4
|
feat(ai-builder): Make eval executionScenarios optional for build-only cases (no-changelog) (#33252)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-30 09:41:14 +00:00 |
|
José Braulio González Valido
|
1d28330d18
|
feat(ai-builder): Dual-tenant LangSmith reads for Instance AI evals (no-changelog) (#33230)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 17:17:14 +00:00 |
|
José Braulio González Valido
|
23d70d1bb9
|
feat(ai-builder): Source eval test cases from LangTracer (no-changelog) (#33067)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 10:17:49 +00:00 |
|
Arvin A
|
9b7451f387
|
ci: Record git provenance metadata on eval experiments (no-changelog) (#33024)
|
2026-06-29 09:12:31 +00:00 |
|
José Braulio González Valido
|
c3741ce12a
|
feat(ai-builder): Re-run Instance AI evals against the PR head on demand (no-changelog) (#33148)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 06:00:43 +00:00 |
|
José Braulio González Valido
|
d78aba164e
|
test(ai-builder): Add absolute green-gate verdict for pr-tier evals (no-changelog) (#32984)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-26 10:00:06 +00:00 |
|
Milorad FIlipović
|
5b77a717b0
|
fix(core): Handle array-style conversations in mcp evals (no-changelog) (#33013)
|
2026-06-25 11:53:57 +00:00 |
|
Milorad FIlipović
|
e12ce0ead0
|
feat(core): Enable LangSmith for mcp evaluations (no-changelog) (#32995)
|
2026-06-25 09:33:22 +00:00 |
|
Milorad FIlipović
|
d3dd105aae
|
feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916)
|
2026-06-25 06:33:50 +00:00 |
|
José Braulio González Valido
|
fe11536df1
|
feat(ai-builder): Add conversation pre-seeding to workflow evals (no-changelog) (#32196)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-06-23 17:30:30 +00:00 |
|
José Braulio González Valido
|
13239d1cfe
|
feat(ai-builder): Add per-test-case eval credentials via thread credential-view pinning (no-changelog) (#32161)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-06-22 14:02:57 +00:00 |
|
yehorkardash
|
d501854409
|
fix(core): Deduplicate isRecord (no-changelog) (#32469)
|
2026-06-22 08:35:03 +00:00 |
|
Riqwan Thamir
|
b60bc923d4
|
feat(core): Add ability to view agent traces locally under a flag (no-changelog) (#32397)
|
2026-06-17 08:36:38 +00:00 |
|
José Braulio González Valido
|
5fa988104b
|
test(ai-builder): Richer multi-turn eval framework (no-changelog) (#32054)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-11 12:57:08 +00:00 |
|
Milorad FIlipović
|
6166a1a94d
|
chore(core): Respect buildCwd when discovering claude config in evaluations (no-changelog) (#31955)
|
2026-06-09 15:16:30 +00:00 |
|
oleg
|
77b95c611d
|
feat(core): Harden Instance AI eval attribution and diagnostics (no-changelog) (#31951)
|
2026-06-09 12:10:10 +00:00 |
|
José Braulio González Valido
|
7791a940dd
|
feat(ai-builder): Author-level conversation expectations on eval test cases (no-changelog) (#31787)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-09 10:06:07 +00:00 |
|
Milorad FIlipović
|
9bb77cc55e
|
feat(core): Allow deleting pre-built workflows after evaluating (no-changelog) (#31960)
|
2026-06-09 08:50:31 +00:00 |
|
oleg
|
52a1a0809a
|
feat(core): Decouple Instance AI workflow verification from planning (#31340)
Co-authored-by: Riqwan Thamir <rmthamir@gmail.com>
|
2026-06-05 10:44:47 +00:00 |
|
José Braulio González Valido
|
46a222a15b
|
ci: Re-enable Instance AI evals on PRs with cost-bounded trigger (no-changelog) (#31430)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-05 08:40:23 +00:00 |
|
Bernhard Wittmann
|
f4e998f245
|
fix(core): Prefer MCP registry nodes when wiring AI Agent tools (#30774)
Co-authored-by: Roman Davydchuk <roman.davydchuk@n8n.io>
|
2026-06-04 12:24:13 +00:00 |
|
José Braulio González Valido
|
f25e12de87
|
ci(ai-builder): Add iterations + experiment-name inputs to instance-ai eval dispatch (no-changelog) (#31631)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-04 09:57:08 +00:00 |
|
Albert Alises
|
332d2df44e
|
fix(core): Move instance AI builds to a skill (#31412)
|
2026-06-02 16:06:00 +00:00 |
|
José Braulio González Valido
|
2a1f3d6b2d
|
feat(ai-builder): Add datasets field for PR-tier suite (no-changelog) (#31429)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-02 13:30:31 +00:00 |
|
José Braulio González Valido
|
64f25b2ad8
|
feat(core): Show eval-mock executions in canvas list (no-changelog) (#31244)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-02 13:14:51 +00:00 |
|
Milorad FIlipović
|
9087a5ac6d
|
fix(core): Fix multi-turn evals for mcp (no-changelog) (#31470)
|
2026-06-02 07:33:08 +00:00 |
|
Raúl Gómez Morales
|
24e95b164a
|
refactor(core): Share scrubSecretsInText via @n8n/utils (no-changelog) (#31273)
|
2026-05-29 14:49:24 +00:00 |
|
Arvin A
|
55d8b59a48
|
feat(core): Stream tool calls and ship M3 fixtures from LLM eval wire server (no-changelog) (#30983)
|
2026-05-27 14:53:43 +01:00 |
|
Albert Alises
|
8bb5db3bbd
|
feat(core): Add runtime skills to Instance AI builders (no-changelog) (#30838)
|
2026-05-27 06:54:40 +00:00 |
|
José Braulio González Valido
|
700b32237f
|
feat(ai-builder): Surface WHAT-dimension binary checks per built workflow (no-changelog) (#30932)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-26 12:18:52 +01:00 |
|
José Braulio González Valido
|
96a9521394
|
ci: Use PR head ref in eval experiment names (no-changelog) (#30898)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-22 11:06:50 +00:00 |
|
José Braulio González Valido
|
81ea56fa6b
|
test(ai-builder): Add multi-turn capability for IAI evals (no-changelog) (#30586)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-21 13:03:35 +00:00 |
|
oleg
|
d7d2cc1442
|
feat(core): Add native agent substrate (no-changelog) (#30015)
Signed-off-by: Oleg Ivaniv <me@olegivaniv.com>
|
2026-05-19 13:48:45 +00:00 |
|
Mutasem Aldmour
|
2fd54d8230
|
feat(core): Curate workflow examples for the builder sandbox (#30025)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-13 06:45:39 +00:00 |
|
Milorad FIlipović
|
54d62bb4a1
|
fix(core): Update instance-ai evaluator to include pinned subnodes and allow all mcp tools (#30292)
|
2026-05-12 09:13:01 +00:00 |
|
Mutasem Aldmour
|
0feec2fea6
|
fix(core): Make placeholder() return string (no-changelog) (#30100)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-11 11:32:35 +00:00 |
|
Mutasem Aldmour
|
d0367a00e8
|
chore: Align pairwise eval builder with production handover (#30019)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-11 11:00:37 +00:00 |
|
José Braulio González Valido
|
30d9a168bc
|
feat(ai-builder): Add --prebuilt-workflows flag for eval CLI (no-changelog) (#29830)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-07 11:47:29 +00:00 |
|
Albert Alises
|
869dc32c15
|
feat(ai-builder): Speeds up Instance AI eval by parallelizing iterations and trimming mock handler (no-changelog) (#29839)
|
2026-05-06 08:15:33 +00:00 |
|
José Braulio González Valido
|
bbe3e2d148
|
feat(ai-builder): Add per-PR eval regression detection vs LangSmith baseline (#29456)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-06 08:15:08 +00:00 |
|