José Braulio González Valido
|
1575fce711
|
fix(ai-builder): Bound eval lane requests and stop abandoned mocked executions (no-changelog) (#35228)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-06 08:23:37 +00:00 |
|
José Braulio González Valido
|
166771c77d
|
feat(ai-builder): Push a seeded case, and hand the agent its workflow (no-changelog) (#35304)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-05 16:09:01 +00:00 |
|
José Braulio González Valido
|
7c61f2826a
|
fix(ai-builder): Give a case's scenario data tables per-run names (no-changelog) (#35543)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-05 12:48:00 +00:00 |
|
José Braulio González Valido
|
d57a81ac60
|
fix(ai-builder): Keep model-provider outages out of eval builder scores (no-changelog) (#35293)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-04 10:52:11 +00:00 |
|
José Braulio González Valido
|
e62417356f
|
feat(ai-builder): Collapse the eval case's three seed keys into one seed union (no-changelog) (#35292)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-03 14:37:06 +00:00 |
|
Mutasem Aldmour
|
22c8117321
|
fix(ai-builder): Route eval report artifacts through --output-dir (no-changelog) (#35083)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-07-29 11:04:42 +00:00 |
|
Luka Zivkovic
|
650d893151
|
feat(ai-builder): Emit transcriptPerRun and buildErrorPerRun in eval-results.json (no-changelog) (#35078)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-28 19:25:22 +00:00 |
|
José Braulio González Valido
|
632ef22c0c
|
feat(ai-builder): Carry an eval case's conversation seed in the case body (no-changelog) (#35074)
Build: Benchmark Image / build (push) Waiting to run
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (24.18.0) (push) Waiting to run
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Util: Sync API Docs / sync-public-api (push) Waiting to run
|
2026-07-28 16:26:08 +00:00 |
|
José Braulio González Valido
|
b0a10229a0
|
refactor(ai-builder): Split the eval harness runner into domain modules (no-changelog) (#34834)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-27 09:01:09 +00:00 |
|
José Braulio González Valido
|
cbe5710c4c
|
feat(ai-builder): Report per-case claude build cost for MCP eval builds (no-changelog) (#34777)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-23 18:42:09 +00:00 |
|
José Braulio González Valido
|
b93a99945b
|
feat(ai-builder): Harden the eval harness — crash-recovery journal, parity fixes, extension points (no-changelog) (#34747)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-23 12:25:55 +00:00 |
|
José Braulio González Valido
|
463d50b1bd
|
refactor(ai-builder): Decompose the eval CLI into phase modules with typed seams (no-changelog) (#34691)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-22 16:25:44 +00:00 |
|