Commit Graph

90 Commits

Author SHA1 Message Date
Ali Elkhateeb
691bf7bdfc
refactor(API): Move evaluation test-run reads behind a service (no-changelog) (#37199)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Dmitrii <dmitrii.kulikov@n8n.io>
2026-09-01 07:14:28 +00:00
Rick Gale
72283bd802
fix(core): Fix evaluation runs failing when the Evaluation Trigger feeds the entry node (#36975)
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
2026-08-28 15:14:58 +00:00
Charlie Kolb
440a14a859
refactor(core): Hoist branch read-only check into a core instance write-access service (#35903)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
2026-08-14 08:24:24 +00:00
Arvin A
e6a08eec58
fix(core): Normalize eval-collection scores per-run and harden re-run (no-changelog) (#34736) 2026-07-24 14:14:49 +00:00
Arvin A
df3e092473
feat(core): Generate eval collection insights with an LLM (no-changelog) (#34254)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-22 23:38:11 +00:00
Arvin A
babc0b7344
fix(core): Fix eval-collection scoring, re-run and progress states (no-changelog) (#34475) 2026-07-21 16:08:38 +00:00
Arvin A
0f0d373a59
fix(core): Compile eval LLM-judge chat model at its current node version (no-changelog) (#34565) 2026-07-21 14:14:24 +00:00
Andreas Fitzek
be786e2802
chore(core): Lock the @n8n/typeorm import ratchet and document the boundary (no-changelog) (#34370) 2026-07-21 08:26:21 +00:00
Arvin A
dde77cb7d3
feat(editor): Add per-case compare tabs to eval collection compare view (#33880) 2026-07-17 09:46:40 +00:00
James Martin
a89817dc92
fix(core): Add project ID and project name to log stream events (#33854) 2026-07-16 11:55:16 +00:00
Benjamin Schroth
cc38d09efd
feat(core): Evaluations Tests panel — backend + contract (no-changelog) (#34303) 2026-07-16 11:22:46 +00:00
Arvin A
38894a067a
feat(core): Add config-evals skill for Instance AI eval creation (no-changelog) (#34082)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-15 12:49:31 +00:00
Benjamin Schroth
18b34cab77
feat(API): Add public API endpoints to trigger and cancel evaluation test runs (#33979) 2026-07-14 09:03:36 +00:00
Matsu
0d465d4428
test: Migrate cli package from Jest to Vitest (#31804)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Iván Ovejero <ivov.src@gmail.com>
2026-06-29 21:19:56 +03:00
Albert Alises
22167a9eb6
fix(core): Improve backend route handling (#31350) 2026-06-25 07:45:19 +00:00
Benjamin Schroth
52e7df6b59
feat(core): Expose $evaluation.runId expression global in eval executions (#32843) 2026-06-24 12:57:29 +00:00
Benjamin Schroth
30fd834c5b
fix(editor): Show execution link on failed evaluation test cases (#32873) 2026-06-24 12:57:24 +00:00
Benjamin Schroth
19eeb5edbd
fix(core): Make workflow evaluations work alongside config evals (#32384) 2026-06-22 10:37:56 +00:00
dmolenaars
ea9fd9ed7b
chore(alibaba cloud node): rename display names with qwen cloud (#32632)
Co-authored-by: Dawid Myslak <dawid.myslak@gmail.com>
2026-06-19 14:58:09 +00:00
Benjamin Schroth
713094c7eb
feat: Add successful executions to evaluation dataset (#32308)
Some checks are pending
Build: Benchmark Image / build (push) Waiting to run
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (24.16.0) (push) Waiting to run
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Util: Sync API Docs / sync-public-api (push) Waiting to run
2026-06-16 13:58:34 +00:00
n8n-assistant[bot]
71262655e4
chore: Bundle/2.x (#32031)
Co-authored-by: Matsu <matias.huhta@n8n.io>
Co-authored-by: Dawid Myslak <dawid.myslak@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Arvin A <51036481+DeveloperTheExplorer@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Dimitri Lavrenük <20122620+dlavrenuek@users.noreply.github.com>
Co-authored-by: Garrit Franke <32395585+garritfra@users.noreply.github.com>
Co-authored-by: Jaakko Husso <jaakko@n8n.io>
Co-authored-by: Daria <daria.staferova@n8n.io>
Co-authored-by: Oğuz Eroğlu <oguz.eroglu@n8n.io>
Co-authored-by: Robin Braumann <robin.braumann@n8n.io>
Co-authored-by: oleg <me@olegivaniv.com>
Co-authored-by: Riqwan Thamir <rmthamir@gmail.com>
Co-authored-by: José Braulio González Valido <jose.gonzalez@n8n.io>
Co-authored-by: Alexander Gekov <40495748+alexander-gekov@users.noreply.github.com>
Co-authored-by: Bernhard Wittmann <bernhard.wittmann@n8n.io>
2026-06-10 07:42:43 +00:00
Benjamin Schroth
2400bfed8b
feat(core): Evaluations wizard backend (no-changelog) (#31357) 2026-06-02 13:13:21 +00:00
Arvin A
6137d25509
feat(core): Add AI insights endpoint for eval collections (TRUST-80) (#30301) 2026-05-20 10:35:41 +00:00
Arvin A
315f4d3aba
feat(editor): Productize parallel evaluation execution (#30453)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-18 11:51:52 +00:00
Arvin A
e630e7e489
feat(core): Add eval collection service + REST + runner integration (TRUST-72) (#30218) 2026-05-14 10:48:46 +00:00
Arvin A
6f9b99a3cf
feat(editor): Eval run detail loading + error states (TRUST-70 follow-up) (#29817)
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
2026-05-11 11:36:03 +00:00
Benjamin Schroth
8116e0a485
feat(core): Add multi-config evaluations backend (#29784) 2026-05-08 12:24:17 +00:00
Arvin A
9014baea7e
feat(editor): Redesign evaluation run detail page (#29592) 2026-05-07 15:02:59 +00:00
Arvin A
4c76aa1467
feat(core): Run evaluation test cases in parallel behind PostHog rollout flag (#29412) 2026-05-04 13:18:01 +00:00
Elias Meire
5b6ee17c81
feat(core): Add signature validation for waiting webhooks and forms (#24159)
Co-authored-by: Michael Kret <88898367+michael-radency@users.noreply.github.com>
2026-03-23 11:48:52 +00:00
Guillaume Jacquart
95ac4a46bd
fix(core): Fix IDOR in test-runs endpoint by consolidating access checks (#27305) 2026-03-23 10:56:36 +00:00
Arvin A
87afcd8db4
fix(core): Force full execution data fetching for evaluation test runs (#27335) 2026-03-23 09:56:05 +00:00
Benjamin Schroth
4fb5ae630b
fix(core): Implement evaluation run cancellation for multi-main (#25353)
Co-authored-by: Danny Martini <danny@n8n.io>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-02-18 15:42:53 +00:00
Albert Alises
5d925058ad
fix: Handle missing trigger node run data gracefully (#25828) 2026-02-17 09:01:53 +00:00
Iván Ovejero
5d481988a9
perf(core): Lazyload login strategies and external secrets (#24693) 2026-01-22 13:43:57 +00:00
Marc Littlemore
ae1fb77203
feat(core): Add execution source to workflow-executed event (#24058) 2026-01-12 08:59:07 +00:00
Eugene
d9d5a01ca5
fix(core): Error running evaluations in queue mode (#23248) 2025-12-16 12:39:53 +01:00
mfsiega
9319139a08
feat(core): Switch to structured destination node (no-changelog) (#22143)
Co-authored-by: Danny Martini <danny@n8n.io>
Co-authored-by: Claude <noreply@anthropic.com>
2025-11-24 16:13:37 +01:00
mfsiega
3857f6fd44
refactor(core): Always use RunExecutionData factory (no-changelog) (#22096)
Co-authored-by: Danny Martini <danny@n8n.io>
2025-11-21 13:42:13 +01:00
Tomi Turtiainen
d6f5c64c58
refactor(core): Add factory functions to create instances of IRunExecutionData (#21554)
Co-authored-by: Danny Martini <danny@n8n.io>
2025-11-17 20:19:50 +02:00
Iván Ovejero
870036820f
refactor(core): Complete backend config migration (#20903) 2025-10-21 10:05:06 +02:00
mfsiega
0681e78eb3
fix(core): Add cancellation reasons (#20238) 2025-10-01 15:52:44 +02:00
Suguru Inoue
e25131613b
refactor: Clean up partial exec version flag (#19598)
Co-authored-by: Danny Martini <danny@n8n.io>
2025-09-24 19:07:10 +02:00
Jaakko Husso
323180ea61
feat(Evaluation Node): Add support for Data Tables as evaluations data source (#19700) 2025-09-19 15:53:49 +03:00
jeanpaul
03c75c365b
fix(core): Fix metric default value handling and add AI model connection validation for setMetric operation in Evaluation (#18088) 2025-08-08 12:38:58 +02:00
Mutasem Aldmour
c18fabb419
feat: Track inputs and outputs in Evaluations (#17404) 2025-07-24 18:58:37 +02:00
jeanpaul
a34b30acc7
feat(n8n Evaluation Node): Add pre-defined metrics to the "Set Metrics" operation (#17127) 2025-07-11 13:58:26 +02:00
Iván Ovejero
f3ef0a713c
refactor(core): Lintfix cli package (#17125) 2025-07-08 19:32:02 +02:00
Benjamin Schroth
57b914dcd9
fix(core): Improve handling of disabled Set Metrics node (#17085) 2025-07-08 19:16:08 +02:00
jeanpaul
e982d9144b
feat: Make the 'set output' node optional if you inserted a 'set metrics' node (no-changelog) (#16955) 2025-07-04 14:55:23 +02:00