n8n/packages/@n8n/instance-ai/evaluations/data
Arvin Ansari 33ad2d3680 test(core): Grade node usage over a folder structure (no-changelog)
Two cases where the answer needs the node composition of a set of workflows, not
their names or their graphs.

- `finds-the-real-users-of-a-node-type`: inside one folder, three workflows use
  the Postgres node and none says so in its name, while two more carry Postgres
  in the NAME and never use it. A name filter returns exactly the wrong two.
- `reads-a-folders-node-conventions-before-extending-it`: what a folder is built
  out of, before adding to it. Two workflows outside the folder use nodes that
  appear nowhere inside it, so an instance-wide summary gives the wrong
  convention.

Both are folder-scoped rather than instance-wide, for a reason worth recording:
the eval instance is shared and already holds unrelated workflows, so an
instance-wide count is not a fact a case can assert. Scoping also makes them
test the two capabilities composed — the folder bounds the set, the index says
which members actually contain the node.

The out-of-folder pair in the second case deliberately avoids Postgres: cases
share one project and run concurrently, so one case's seeds can otherwise answer
another case's question.
2026-08-27 19:06:06 +02:00
..
agents feat(ai-builder): Push agent intent eval cases from data/agents and drop synced case files (no-changelog) (#34957) 2026-07-28 07:25:30 +00:00
discovery test(core): Add MCP registry discovery evals (no-changelog) (#36063) 2026-08-18 12:28:05 +00:00
subagent fix(core): Prevent workflow builder from making HTTP requests in Code nodes (no-changelog) (#32084) 2026-06-11 12:08:06 +00:00
workflows test(core): Grade node usage over a folder structure (no-changelog) 2026-08-27 19:06:06 +02:00
source.ts test(core): Extend Instance AI intent eval fixtures (no-changelog) (#33224) 2026-07-07 12:49:32 +00:00