José Braulio González Valido
|
5b149495c5
|
feat(ai-builder): Grade token consumption and memory compaction in Instance AI evals (no-changelog) (#38974)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-22 11:12:10 +00:00 |
|
José Braulio González Valido
|
326030418d
|
fix(core): Attribute a draft-Agent eval scenario to the harness, not the builder (no-changelog) (#39007)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-18 11:44:52 +00:00 |
|
Roman Makowiak
|
5b199f5cdf
|
feat(core): Add folder seeding to the Instance AI eval harness (no-changelog) (#38550)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-16 07:47:46 +00:00 |
|
Michael Drury
|
684b930fa6
|
feat(core): Improve Agent Builder evaluation and intent routing (#38329)
|
2026-09-14 13:13:51 +00:00 |
|
Luka Zivkovic
|
70e5a2bf16
|
feat: Export structured agent artifacts in eval results (#38394)
|
2026-09-11 15:11:02 +00:00 |
|
oleg
|
1bee3bcac7
|
feat(core): Add progressive workflow building (no-changelog) (#37996)
|
2026-09-10 13:42:43 +00:00 |
|
Robin Braumann
|
cf999248f9
|
refactor(core): Replace local isRecord and model-id helper copies with shared ones (no-changelog) (#38052)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-08 12:05:27 +00:00 |
|
Arvin A
|
95f7e6a8a8
|
feat(core): Run seeded workflows before the graded turn in Instance AI evals (no-changelog) (#37516)
|
2026-09-03 14:09:18 +00:00 |
|
José Braulio González Valido
|
614dfa62f8
|
feat(ai-builder): Surface thread provenance on Instance AI traces (no-changelog) (#36909)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-28 07:50:01 +00:00 |
|
Bernhard Wittmann
|
62d5de3ec7
|
feat: Add the credential-setup browser eval lane (no-changelog) (#35982)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-13 15:56:24 +00:00 |
|
Svetoslav Dekov
|
9205eb3f19
|
test(core): Support credential seeding in MCP workflow evals (no-changelog) (#35782)
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (22.23.2) (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (24.18.1) (push) Waiting to run
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Build: v3 Nightly Docker Images / Compute date tag (push) Has been cancelled
Build: v3 Nightly Docker Images / Build and push v3-nightly images (push) Has been cancelled
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ricardo Espinoza <ricardo@n8n.io>
|
2026-08-10 19:56:03 +00:00 |
|
Svetoslav Dekov
|
ff37ef5b3f
|
ci(ai-builder): Gate the mcp-gate eval tier absolutely (no-changelog) (#35762)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-06 14:37:04 +00:00 |
|
José Braulio González Valido
|
1575fce711
|
fix(ai-builder): Bound eval lane requests and stop abandoned mocked executions (no-changelog) (#35228)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-06 08:23:37 +00:00 |
|
José Braulio González Valido
|
166771c77d
|
feat(ai-builder): Push a seeded case, and hand the agent its workflow (no-changelog) (#35304)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-05 16:09:01 +00:00 |
|
José Braulio González Valido
|
7c61f2826a
|
fix(ai-builder): Give a case's scenario data tables per-run names (no-changelog) (#35543)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-05 12:48:00 +00:00 |
|
José Braulio González Valido
|
d57a81ac60
|
fix(ai-builder): Keep model-provider outages out of eval builder scores (no-changelog) (#35293)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-04 10:52:11 +00:00 |
|
José Braulio González Valido
|
e62417356f
|
feat(ai-builder): Collapse the eval case's three seed keys into one seed union (no-changelog) (#35292)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-03 14:37:06 +00:00 |
|
Mutasem Aldmour
|
22c8117321
|
fix(ai-builder): Route eval report artifacts through --output-dir (no-changelog) (#35083)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-07-29 11:04:42 +00:00 |
|
Luka Zivkovic
|
650d893151
|
feat(ai-builder): Emit transcriptPerRun and buildErrorPerRun in eval-results.json (no-changelog) (#35078)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-28 19:25:22 +00:00 |
|
José Braulio González Valido
|
632ef22c0c
|
feat(ai-builder): Carry an eval case's conversation seed in the case body (no-changelog) (#35074)
Build: Benchmark Image / build (push) Waiting to run
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (24.18.0) (push) Waiting to run
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Util: Sync API Docs / sync-public-api (push) Waiting to run
|
2026-07-28 16:26:08 +00:00 |
|
José Braulio González Valido
|
b0a10229a0
|
refactor(ai-builder): Split the eval harness runner into domain modules (no-changelog) (#34834)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-27 09:01:09 +00:00 |
|
José Braulio González Valido
|
cbe5710c4c
|
feat(ai-builder): Report per-case claude build cost for MCP eval builds (no-changelog) (#34777)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-23 18:42:09 +00:00 |
|
José Braulio González Valido
|
b93a99945b
|
feat(ai-builder): Harden the eval harness — crash-recovery journal, parity fixes, extension points (no-changelog) (#34747)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-23 12:25:55 +00:00 |
|
José Braulio González Valido
|
463d50b1bd
|
refactor(ai-builder): Decompose the eval CLI into phase modules with typed seams (no-changelog) (#34691)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-22 16:25:44 +00:00 |
|