Riqwan Thamir
38688aafe4
ci: Throttle Instance AI evals for Baseten rate limits
...
Expose lanes/eval-concurrency knobs and auto-set 1/2 (plus a 10h timeout)
when model is baseten/*, so GLM experiments fit Basic verified TPM/RPM.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-25 18:35:51 +02:00
Riqwan Thamir
509719d27c
chore: add opus 5
2026-07-25 18:35:48 +02:00
Riqwan Thamir
f556fd381e
feat(instance-ai): Add Baseten GLM 5.2 provider support and eval options
...
Integrate @ai-sdk/baseten for native GLM routing, map GLM 5.2 thinking to high effort, raise the default max output token cap to avoid reasoning-only truncation, and wire Baseten models into Instance AI eval experiments via EVALS_BASETEN_KEY.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-25 18:35:43 +02:00
Riqwan Thamir
a19d2d9cfe
ci: Add openai/gpt-5.6-luna to Instance AI evals model options (no-changelog)
...
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-25 18:35:40 +02:00
Riqwan Thamir
fa8d367c04
ci: Add openai/gpt-5.6-terra to Instance AI evals model options (no-changelog)
...
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-25 18:35:39 +02:00
Riqwan Thamir
6466dbd6ea
feat(core): Pin OpenAI Instance AI thinking to medium for GPT-5.6 Sol (no-changelog)
...
Use AI SDK reasoningEffort medium by default, expand OpenAI effort types for
GPT-5.6, bump @ai-sdk/openai, and route openai/* evals through EVALS_OPENAI_KEY.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-25 18:35:38 +02:00
Riqwan Thamir
8ecbc45120
ci: Support xAI Grok models in Instance AI evals experiments (no-changelog)
...
Route xai/* lane builds through EVALS_XAI_KEY so experiments like
xai/grok-4.5 can run without changing the Opus default or Anthropic verifier.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-25 18:35:00 +02:00
Riqwan Thamir
54cd1a0417
ci: Support OpenRouter models in Instance AI evals experiments (no-changelog)
...
Route openrouter/* lane builds through EVALS_OPENROUTER_KEY while keeping
Opus/Anthropic as the default and for the verifier CLI.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-25 18:34:54 +02:00
Charlie Kolb
151ca180f9
ci: Pin standalone package latest dist-tag to newest beta (no-changelog) ( #34770 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-23 12:57:54 +00:00
Declan Carroll
96121cccc9
ci: Auto-refresh e2e impact map from nightly coverage run ( #34427 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-21 09:33:24 +00:00
José Braulio González Valido
32d4c1a123
ci(ai-builder): Point eval workflows at the consolidated LangTracer baseline suite (no-changelog) ( #34402 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-20 13:55:41 +00:00
Declan Carroll
f7f0556f65
build: Bump base and n8n images to Node 24.18.0 (no-changelog) ( #34337 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-17 08:45:32 +00:00
Matsu
706e11648f
ci: Update standalone package publish to match new conventions ( #34305 )
2026-07-16 10:36:25 +03:00
n8n-cat-bot[bot]
62b4904f0f
ci: Fix filter quoting in standalone package release build ( #34261 )
...
Co-authored-by: n8n-cat-bot[bot] <n8n-cat-bot[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-15 15:11:08 +00:00
José Braulio González Valido
a774a18b95
ci(ai-builder): Fetch eval test cases from LangTracer (no-changelog) ( #33982 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 10:52:27 +00:00
José Braulio González Valido
2233d720ae
ci: Bound and instrument Instance AI eval lane containers (no-changelog) ( #33903 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 09:28:46 +00:00
Matsu
223dca9d7b
ci: Ping release captain when release fails ( #34121 )
2026-07-14 07:47:59 +00:00
Garrit Franke
6cb9a2f13b
fix: Raise community stale workflow operations-per-run so it reaches recent PRs ( #34070 )
2026-07-13 12:22:56 +00:00
n8n-cat-bot[bot]
c91840dfa9
chore: Per-PR performance comparison check is flaky/noisy — investigate, scope, or temporarily disable ( #33967 )
...
Co-authored-by: n8n-cat-bot[bot] <n8n-cat-bot[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-10 11:25:25 +00:00
Garrit Franke
ace1ed3bc8
ci: Pick up Needs Feedback label in close-stale community PRs workflow ( #33902 )
2026-07-09 10:37:39 +00:00
Matsu
885c250b12
ci: Set up v3 branch sync and nightly build workflows (no-changelog) ( #33678 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-09 12:49:39 +03:00
Garrit Franke
c11aaace98
ci: Add workflow to close stale community PRs awaiting contributor feedback ( #33889 )
2026-07-09 09:17:57 +00:00
Charlie Kolb
c8d3c82b23
ci: Block merge when 'Do Not Merge' label is present (no-changelog) ( #33828 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-09 08:37:42 +00:00
Matsu
8bb6489918
chore: Remove remaining Jest references (no-changelog) ( #33412 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
2026-07-09 09:29:24 +03:00
Milorad FIlipović
c5d65998da
test: Reduce non-builder noise in MCP workflow evals (no-changelog) ( #33565 )
2026-07-06 13:48:11 +00:00
Charlie Kolb
b610b42558
ci: Rename storybook and chromatic workflows ( #33543 )
2026-07-06 11:05:57 +00:00
José Braulio González Valido
4d11639cf1
test(ai-builder): Add plan-rejection eval and harden multi-turn eval consistency (no-changelog) ( #33433 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-06 06:11:22 +00:00
Milorad FIlipović
579656db2e
test: Parallelize MCP workflow evals across build lanes (no-changelog) ( #33468 )
2026-07-03 08:33:42 +00:00
José Braulio González Valido
a8f1b2c1b8
ci: Scope Instance AI evals dispatcher to PR gating (no-changelog) ( #33499 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-03 07:29:09 +00:00
Charlie Kolb
251ea90070
ci: Reconcile backport labels on minor release ( #33451 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-02 14:39:51 +00:00
José Braulio González Valido
af009e64a1
fix(ai-builder): Trace eval backend threads and add model input to exec evals CI (no-changelog) ( #33458 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-02 14:17:47 +00:00
Emilia
3286414ac0
feat(core): Add durable scheduler storage adapter (no-changelog) ( #33394 )
...
Build: Benchmark Image / build (push) Waiting to run
CI: Master (Build, Test, Lint) / Build for Github Cache (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (22.22.3) (push) Waiting to run
CI: Master (Build, Test, Lint) / Unit tests (24.16.0) (push) Waiting to run
CI: Master (Build, Test, Lint) / Lint (push) Waiting to run
CI: Master (Build, Test, Lint) / Performance (push) Waiting to run
CI: Master (Build, Test, Lint) / Notify Slack on failure (push) Blocked by required conditions
Util: Sync API Docs / sync-public-api (push) Waiting to run
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-02 13:16:26 +00:00
Charlie Kolb
b6d3d85dc5
ci: Trigger backport when a backport label is added to a merged PR ( #33449 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-02 11:25:00 +00:00
Matsu
df97053888
chore: Remove references to Jest ( #33282 )
2026-07-01 09:03:25 +00:00
Tomi Turtiainen
7fb04cdb98
refactor: Remove @n8n/utils barrel export (no-changelog) ( #33082 )
2026-06-30 16:05:24 +03:00
Matsu
a068f3b57b
test: Cap per-suite test fork pool to bound CI parallelism ( #32939 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-30 05:47:06 +00:00
Matsu
f4ef254bd7
ci: Comment out schedules from release workflows ( #33223 )
2026-06-29 12:32:50 +00:00
José Braulio González Valido
0b992c8ac1
fix(ai-builder): Send eval build traces to a separate LangSmith project (no-changelog) ( #33178 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-29 09:13:57 +00:00
Matsu
4c933be93a
ci: Improve Windows build resilience with retry and concurrency cap ( #33194 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-29 09:07:23 +00:00
José Braulio González Valido
c3741ce12a
feat(ai-builder): Re-run Instance AI evals against the PR head on demand (no-changelog) ( #33148 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-29 06:00:43 +00:00
Matsu
0c7a61d54a
ci: Sanitize workflow inputs ( #33073 )
2026-06-29 08:56:35 +03:00
Milorad FIlipović
2c80e14f04
ci: Add MCP workflow evals CI (no-changelog) ( #33019 )
2026-06-26 08:53:01 +00:00
Sean Molenaar
268bec6f57
chore: Add zizmor security scanning ( #31990 )
2026-06-25 12:45:03 +00:00
Matsu
d332e7c4be
ci: Don't limit quality checks to only master ( #32938 )
2026-06-24 11:46:21 +00:00
n8n-cat-bot[bot]
0ef6044fbb
fix: Populate mutation-health ledger churn/fix_density from setup ( #32903 )
...
Co-authored-by: n8n-cat-bot[bot] <n8n-cat-bot[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-24 07:14:28 +00:00
n8n-cat-bot[bot]
0297d1467a
ci: Disable nightly schedule for workflow tests pipeline ( #32848 )
...
Co-authored-by: n8n-cat-bot[bot] <n8n-cat-bot[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-23 12:35:02 +00:00
Jaakko Husso
28182fd68b
chore: Start publishing snapshots also on dev, separate prod and dev Daytona keys ( #32747 )
2026-06-23 06:37:50 +00:00
n8n-cat-bot[bot]
8cf6bb64ac
ci: Remove editor-ui grind CI workflow ( #32764 )
...
Co-authored-by: n8n-cat-bot[bot] <n8n-cat-bot[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-22 12:45:41 +00:00
n8n-cat-bot[bot]
438cade960
ci: Publish sizing-matrix artifacts and make aggregator ( #32726 )
...
Co-authored-by: n8n-cat-bot[bot] <n8n-cat-bot[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-22 12:32:37 +00:00
n8n-cat-bot[bot]
bc507027c4
ci: Drive mutation-health nightly matrix from global picker (with ( #32714 )
...
Co-authored-by: n8n-cat-bot[bot] <n8n-cat-bot[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
2026-06-21 11:58:08 +00:00