n8n/packages/@n8n/instance-ai/evaluations/data/workflows
2026-07-08 13:01:29 +00:00
..
agent-with-notion-mcp.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
ai-agent-build-config-eval-placeholder.json test(ai-builder): Add eval cases for evaluation generation (#33719) 2026-07-07 15:29:42 +00:00
ai-agent-build-evals-preserve-production-path.json test(ai-builder): Add eval cases for evaluation generation (#33719) 2026-07-07 15:29:42 +00:00
ai-agent-build-wires-evals-when-asked.json test(ai-builder): Add eval cases for evaluation generation (#33719) 2026-07-07 15:29:42 +00:00
ai-agent-proactively-offers-evals.json test(ai-builder): Add eval cases for evaluation generation (#33719) 2026-07-07 15:29:42 +00:00
airtable-split-to-slack.json fix(core): Improve Instance AI workflow-building reliability (#33530) 2026-07-03 13:27:45 +00:00
applies-each-change-when-asked.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
asks-clarifying-question.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
binary-multipart-upload.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
binary-pdf-download-extract.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
binary-telegram-voice-transcribe.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
binds-existing-credential-without-reasking.json fix(core): Report auto-bound credentials from AI Assistant workflow builds (#33802) 2026-07-08 13:01:29 +00:00
carry-accumulated-facts-across-long-thread.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
confirmation-email-uses-source-not-slack-output.json test(core): Add Instance AI eval cases for recently merged builder changes (no-changelog) (#33763) 2026-07-07 14:12:08 +00:00
contact-form-automation.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
cross-team-linear-report.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
daily-gmail-action-digest.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
daily-slack-summary.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
datatable-exact-spec-schema.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
dont-ask-technical-implementation-choice.json feat(ai-builder): Make eval executionScenarios optional for build-only cases (no-changelog) (#33252) 2026-06-30 09:41:14 +00:00
dont-ask-the-same-question-twice.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
dont-keep-asking-when-told-later.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
dont-reaffirm-fixed-without-rerun.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
dont-reask-answered-question.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
dont-reask-skipped-question.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
error-workflow-no-global-setting.json fix: Improve AI Assistant post-build follow-ups (#33419) 2026-07-02 11:34:21 +00:00
error-workflow-publish-before-assign.json fix: Improve AI Assistant post-build follow-ups (#33419) 2026-07-02 11:34:21 +00:00
feasible-job-digest-no-spurious-friction.json fix(core): Surface infeasible core capabilities instead of silently downgrading (no-changelog) (#33063) 2026-06-26 09:19:17 +00:00
flight-deal-monitor-ber-lax.json fix(core): Improve Instance AI workflow-building reliability (#33530) 2026-07-03 13:27:45 +00:00
flight-status-change-alert.json test: Add Instance AI flight-status-change workflow eval (#33228) 2026-06-30 06:55:40 +00:00
form-to-hubspot.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
github-notion-sync.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
honors-missing-credential-field-correction.json fix(core): Ground WhatsApp Trigger verify-token guidance and add regression evals (no-changelog) (#33095) 2026-06-29 07:39:08 +00:00
http-keep-generic-credential-unknown-service.json feat(core): Prefer predefined credentials over generic auth on HTTP Request nodes (#33298) 2026-07-02 07:50:49 +00:00
http-node-pagination.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
http-predefined-credential-ambiguous-meta-graph.json feat(core): Prefer predefined credentials over generic auth on HTTP Request nodes (#33298) 2026-07-02 07:50:49 +00:00
http-prefer-predefined-credential-stripe.json feat(core): Prefer predefined credentials over generic auth on HTTP Request nodes (#33298) 2026-07-02 07:50:49 +00:00
http-raw-body-param-validation-loop.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
index.ts test(core): Extend Instance AI intent eval fixtures (no-changelog) (#33224) 2026-07-07 12:49:32 +00:00
inspect-errored-expression-before-changing.json fix(core): Improve builder handling of errored expressions (no-changelog) (#33059) 2026-06-26 09:23:39 +00:00
linear-bq-leaderboard.json test(ai-builder): Add multi-turn capability for IAI evals (no-changelog) (#30586) 2026-05-21 13:03:35 +00:00
loop-aggregate-single-request.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-anti-manual-pagination.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-anti-nested-batches.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-chunked-bulk-api.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-execute-once-aggregate-average.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-execute-once-email-after-batch.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-execute-once-slack-digest.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-http-pagination-cursor.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-implicit-per-item-slack.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-multi-branch-convergence.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-no-unnecessary-split-in-batches.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-org-chart-recursion.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-poll-until-complete.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-rate-limit-email-batches.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
loop-subworkflow-each-order.json test(core): Add Instance AI loop pattern workflow eval cases (no-changelog) (#33712) 2026-07-07 07:26:51 +00:00
mock-test-before-credentials.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
mocks-node-with-one-credential.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
mocks-node-with-two-credentials.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
no-http-in-code-node.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
no-self-run-after-partial-verify.json fix(core): Stop the builder from re-running a workflow it just verified (no-changelog) (#33141) 2026-06-29 08:10:44 +00:00
non-ai-build-no-eval-offer.json test(ai-builder): Add eval cases for evaluation generation (#33719) 2026-07-07 15:29:42 +00:00
notification-router.json fix(core): Improve Instance AI workflow-building reliability (#33530) 2026-07-03 13:27:45 +00:00
notion-database-name-not-list-locator.json test(core): Add Instance AI eval cases for recently merged builder changes (no-changelog) (#33763) 2026-07-07 14:12:08 +00:00
order-fulfillment-tolerates-slack-failure.json test(core): Add Instance AI eval cases for recently merged builder changes (no-changelog) (#33763) 2026-07-07 14:12:08 +00:00
order-threshold-notify.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
plan-approval-handoff-verification.json fix(core): Make AI Assistant workflow verification and setup repeatable (#33085) 2026-06-26 13:39:28 +00:00
product-page-agent-question-tool.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
rest-api-data-pipeline.json test(ai-builder): Add absolute green-gate verdict for pr-tier evals (no-changelog) (#32984) 2026-06-26 10:00:06 +00:00
reverify-reflects-applied-credential.json fix(core): Reconcile stale AI Assistant mocked-credential simulation plan before workflow verification (#33808) 2026-07-08 13:01:08 +00:00
revises-plan-after-rejection.json test(ai-builder): Add plan-rejection eval and harden multi-turn eval consistency (no-changelog) (#33433) 2026-07-06 06:11:22 +00:00
set-edit-fields-contract.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
setup-after-mocked-verification-asks-live-test.json fix: Improve AI Assistant post-build follow-ups (#33419) 2026-07-02 11:34:21 +00:00
setup-follow-up-preserves-slack-channel.json fix(core): Make AI Assistant workflow verification and setup repeatable (#33085) 2026-06-26 13:39:28 +00:00
sheet-row-count-notifier.json feat(core): Add more use case evaluations to instance ai (no-changelog) (#32963) 2026-06-25 14:15:30 +00:00
smartassist-form-booking.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
surfaces-infeasible-bank-bill-payment.json fix(core): Surface infeasible core capabilities instead of silently downgrading (no-changelog) (#33063) 2026-06-26 09:19:17 +00:00
surfaces-infeasible-core-capability.json fix(core): Surface infeasible core capabilities instead of silently downgrading (no-changelog) (#33063) 2026-06-26 09:19:17 +00:00
targeted-edit-preserves-configured-details.json test(core): Add Instance AI eval cases for recently merged builder changes (no-changelog) (#33763) 2026-07-07 14:12:08 +00:00
telegram-chatbot-memory-session.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
trading-bot-http-array-normalization.json test: Reduce non-builder noise in MCP workflow evals (no-changelog) (#33565) 2026-07-06 13:48:11 +00:00
verify-by-running-before-claiming-works.json fix(core): Report node errors in workflow verification (#33576) 2026-07-07 08:21:38 +00:00
verify-surfaces-node-error-when-run-succeeds.json test(core): Add Instance AI eval cases for recently merged builder changes (no-changelog) (#33763) 2026-07-07 14:12:08 +00:00
voice-agent-crm-backend.json chore(core): Add test on voice based agent (#33226) 2026-06-29 14:23:40 +00:00
weather-alert-no-prebuild-setup-question.json fix: Prefer placeholders over pre-build setup questions (#32969) 2026-06-25 17:39:39 +00:00
weather-alert.json test(ai-builder): Reproduce explicit scenario values in eval mocks (no-changelog) (#33166) 2026-06-28 15:15:15 +00:00
weather-monitoring.json test(ai-builder): Reproduce explicit scenario values in eval mocks (no-changelog) (#33166) 2026-06-28 15:15:15 +00:00
weather-slack-branch-verification.json fix(core): Make AI Assistant workflow verification and setup repeatable (#33085) 2026-06-26 13:39:28 +00:00
weekly-social-content-scheduler.json feat(core): Add more use case evaluations to instance ai (no-changelog) (#32963) 2026-06-25 14:15:30 +00:00
whatsapp-faq-assistant.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
whatsapp-verify-token-not-a-credential-field.json fix(core): Ground WhatsApp Trigger verify-token guidance and add regression evals (no-changelog) (#33095) 2026-06-29 07:39:08 +00:00
workflow-data-table.json feat(core): Make instanceAI evals more mcp-friendly (no-changelog) (#32916) 2026-06-25 06:33:50 +00:00
workflow-verification-failed-loop-repro.json fix(core): Settle failed workflow verification instead of looping (no-changelog) (#33111) 2026-06-26 13:14:04 +00:00
workflow-verification-loop-repro.json fix(core): Broken workflow verification loop in iAI (no-changelog) (#32979) 2026-06-25 08:20:46 +00:00