Skip to content

health digest 2026-10-05 #6868

Description

@devin-ai-integration

Read-only digest, window 2026-09-28 12:22Z → 2026-10-05 12:22Z. Previous: #6702. Repo now resolves to codewhale-hq/Codewhale.

Recommended actions (ranked by impact)

  1. main is probably red on the required Test (windows-latest) check (inferred). chore(deps): bump uuid from 1.26.0 to 1.27.0 #6826 (uuid-only, parent = main HEAD b059d4f0) fails 14 Windows tests (log) (extension_host bun/native_mcp cluster, windows_native_lpac_bun_owner_boundary, runtime_store_convergence…). wave/0.10.1-next (0.10.1: contributor integration, human-wait lifecycle, and release qualification #6846, merged into main at e8036038) has failed the same set since 10-03 (log). main's own HEAD run was cancelled, so unconfirmed. This blocks all 13 Dependabot PRs.
    • Nightly linux-arm64 link error: undefined reference to 'renameat2' in codewhale_config::private_directory::move_socket_no_replace on musl (log).
  2. Approve the contribution gate for 17 external PRs that have never run required CI. All of their runs are action_required: fix(tools): flag fetch_url and web_run spill artifacts as retrievable evidence #6847–fix(web): bound the fetch SSRF pre-flight DNS lookup #6852, fix(tools): bound and reap pandoc conversions #6854–fix(snapshot): bound git subprocesses so a wedged git cannot stall the turn #6859, feat(automation): archive terminal runs on delete #6864 (13 from asto18089), plus feat(runtime-api): read what one tool call changed, from the snapshots around it #6817 (gaord), fix(tui): drop the commas the locale extraction put after ←, → and ⚠ #6844 (Lstarsky0) and feat(orcarouter): OAuth 2.0 + PKCE connect and a live chat catalog alongside the API key #6867 (hodeswildsmith455-boop). feat(plugins): support reviewed OAuth AI providers #6805, fix(search): honor the configured locale in Bing and DuckDuckGo scrapes #6860 and fix(client): bound non-streaming model requests with a retry-aware envelope #6863 are CONFLICTING with no runs; per AGENTS.md a maintainer resolves conflicts caused only by main moving.
  3. Restore CI and security visibility.
    • Buildkite: the BUILDKITE_READ_TOKEN authenticates, but organizations/hunter-bown returns 404 No organization found and GraphQL viewer.organizations is empty. The token appears to have lost org access, possibly with the move to codewhale-hq. No PR reports buildkite/codewhale-ci.
    • CodeQL: alerts are still unreadable (403). GITHUB_CODEWHALE_SECURITY_PAT is not provisioned (4th week).
  4. Fix the recurring flakes and drift jobs.
    • core::engine::approval::tests::execute_tools_gates_an_extension_tool_before_any_host_call: 11 failures, 2 of which passed on a same-SHA rerun.
    • The timing-based macOS persistence-backlog-budget: enqueue_elapsed_ns=33309879 exceeds 25000000 on main b1313572; also flagged last week.
    • Marketplace connection :: catalog: First-party catalog drift: run python3 scripts/sync-marketplace.py, failing on main HEAD.
  5. Housekeeping.

1. Open PRs: 34 open, 1 stale > 7 d

Required checks (ruleset 15930115): Lint, Test (windows-latest), npm wrapper smoke (ubuntu-latest). buildkite/codewhale-ci is not reported on any PR. No PR has unresolved review threads.

PR Author Age / idle Mergeable Required checks (Lint / Win / npm) Gate
#6393 (draft) AdityaVG13 13 d / 13 d CONFLICTING pass / pass / pass –
#6809, #6812, #6813 dependabot 3 d MERGEABLE / UNKNOWN FAIL / FAIL / FAIL (+Safety gate, Test mac/ubuntu) –
#6821, #6822, #6825 dependabot 2 d MERGEABLE FAIL / pass / pass –
#6810, #6811, #6823, #6824, #6826 dependabot 2–3 d MERGEABLE pass / FAIL / pass –
#6847–52, #6854–59, #6864 asto18089 0 d MERGEABLE / BLOCKED never ran action_required ×6 each
#6860, #6863 asto18089 0 d CONFLICTING never ran –
#6817 gaord 3 d UNKNOWN never ran action_required ×6
#6844 Lstarsky0 0 d MERGEABLE / BLOCKED never ran action_required ×6
#6867 hodeswildsmith455-boop 0 d MERGEABLE / BLOCKED never ran action_required ×6
#6832 aboimpinto 1 d UNKNOWN pass / pass / pass PR-closes ×2
#6805 LIghtJUNction 4 d CONFLICTING never ran –
#6846 Hmbown 0 d MERGEABLE / BLOCKED in progress (Integrations FAIL) –
#6807 (draft) Hmbown 3 d UNKNOWN none –
Commands
gh api graphql --paginate  # pullRequests(states:OPEN){mergeable mergeStateStatus authorAssociation commits(last:1){statusCheckRollup{contexts}} comments(last:1) reviews(last:1) reviewThreads{isResolved}}  -> 34 PRs, 0 unresolved threads
gh api repos/codewhale-hq/Codewhale/rules/branches/main   # required: Lint, Test (windows-latest), npm wrapper smoke (ubuntu-latest)
git log -1 --format='%H %P' pull/6826/head   # 37d3ea1f  parent b059d4f0 (= origin/main)

2. Stale branches: 1

22 remote branches. Only release/0.9.12-prep-20260830 is older than 30 days with no open PR (last commit 2026-08-30, 36 d). There are no snapshot/* branches.

3. CI flake ranking (7 d)

GitHub Actions had 4,342 runs: 3,270 success, 196 failure, 279 cancelled, 98 action_required. (09-29 re-fetched in 6-hour windows to avoid the 1,000-run cap).

  • CI on main (push): 94 runs. 33 success, 5 failure, 56 cancelled. Last week: 72 / 31 / 53.
  • CI on PRs: 358 runs. 110 success, 63 failure, 168 cancelled, 16 action_required.
  • Buildkite codewhale-ci: unavailable. The API returns 404 No organization found (see action 3).

Failed jobs: Test win 41, ubuntu 35, mac 24; PR-closes link 32; Lint 25; Version drift 22; Web Lint 15; RC parity 9; Safety gate 8; npm smoke 7. (31 were compile errors.)

Flaky: a job failed, then passed on a rerun of the same SHA (20 job instances).

Same-SHA fail→pass Test Example
15 PR closes an issue :: link (body-edit rerun, not a test) log
4 Test (ubuntu) "Run tests" step, no test name parsed (fix/l1-config-secrets-crates) log
2 (of 11 fails) core::engine::approval::tests::execute_tools_gates_an_extension_tool_before_any_host_call (win) log
1 (of 9) core::engine::tests::an_isolated_chat_engine_never_revokes_another_engines_extension log
1 each mcp::tests::streamable_http_reset_after_tool_call_post_is_not_replayed (mac), runtime_api::tests::restore_routes_refuse_an_active_turn_in_the_workspace, fleet::manager::tests::worker_exit_observed_after_the_deadline…, Pet conformance :: android log

Most frequent failing tests (349 distinct; consistent per commit, so broken commits rather than flakes):

Jobs SHAs Test Where Example
12–13 each 12 extension_host::tests::{memory_cap_stops_a_bun_host, bun_host_runs_the_dsh_plugin…, raw_agent_presets_*} + 6 extension_host::native_mcp::tests::* ubuntu+win; wave/0.10.1-next and Dependabot PRs on main HEAD log
12 12 tools::subagent::tests::route_replacement::persona_receipt::actual_child_persona_selection… ubuntu+win same
11 11 runtime_api::tests::runtime_store_convergence::real_owner_two_workspace_services…, extension_host::windows::tests::windows_native_lpac_bun_owner_boundary win log
11 8 conformance::events::golden_turn_events_match (incl. main 96263571) mac+ubuntu log
9 7 extension_host::tests::memory_cap_stops_a_node_host ubuntu+win log
6–7 each 6–7 plugins::install::dsh::tests::* (≈20 tests) ubuntu+win log

Other main failures: late_launch_permit_still_gets_the_full_work_budget (win), launch_card_pty::launch_resume_buttons… (mac), idle_managers_sharing_a_store_do_not_poll_it_continuously (win), Lint :: Check formatting (60ea7c22), the macOS budget timing check (×3), and CodeQL Setup at Checkout repository (b1313572).

Commands
gh api --paginate "repos/codewhale-hq/Codewhale/actions/runs?created=<day | 6h window>&per_page=100"   # 4342 runs in window
gh api "repos/.../actions/runs/<id>/jobs?filter=all"    # 665 runs (failed or run_attempt>1) -> 275 failed jobs
gh api "repos/.../actions/jobs/<id>/logs" | grep -E 'test (\S+) \.\.\. FAILED|---- (\S+) stdout ----'   # 120 test-job logs
# flaky = (sha, workflow, job) with a failed attempt n and a successful attempt > n
curl -H "Authorization: Bearer $BUILDKITE_READ_TOKEN" https://api.buildkite.com/v2/organizations/hunter-bown/pipelines/codewhale-ci
  -> 404 No organization found (also for codewhale-hq, codewhale, hmbown)

4. Drift checks (fresh --depth 1 clone of main @ b059d4f0)

Check Result
python3 scripts/check-dead-code-budget.py 253 suppressions (allow=171, expect=82), budget 258 (5 under). Down 7 from last week's 260.
Cargo.toml workspace 0.10.1
CHANGELOG.md top ## [Unreleased], then ## [0.10.1] - 2026-10-01 ✓
npm/codewhale, npm/runtime-sdk, extensions/vscode 0.10.1 ✓
npm/deepseek-tui / web 0.8.49 (legacy, unchanged) / 0.1.0 (untracked)
scripts/release/check-versions.sh --range-audit-advisory Version state OK: workspace=0.10.1, npm=0.10.1, npm-binary=0.10.1, lockfile in sync.

Docs vs product. I parsed 106 registered commands and 96 aliases (non-test code) against backticked /cmd mentions in docs/ and web/.

  • In code, not documented (21): /advisor /anchor /branch /exit /fork /home /import-claude /logout /lsp /new /overview /pin /remote-env /save /structcopy /system /transcript /tree /verbose /voicecontrol /voicesend. /exit is in Help's curated COMMON_COMMANDS but appears in no doc.
  • Documented, not in code: 0 in user-facing docs. Last week's /search flag in docs/CONFIGURATION.md is a URL path, not a command. The rest are in design/archive docs or are the retired /set, which is kept only as migration guidance.
  • Settings: ConfigCategory::ALL has 7 categories (Appearance, ModelsProviders, Work, ToolsMcp, Trust, Motion, Advanced) and /setup STEP_SPECS has 10 steps. No docs/ or web/ page enumerates either list (unchanged).

5. Security posture

Source Open
Dependabot (GraphQL vulnerabilityAlerts(states:OPEN)) 0 (REST /dependabot/alerts: 403)
CodeQL (/code-scanning/alerts?state=open) unavailable: 403 Resource not accessible by integration; GITHUB_CODEWHALE_SECURITY_PAT not provisioned

6. Open issues: 186 (+19 vs 167)

42 opened and 32 closed in the window.

Labels: unlabeled 97, enhancement 47, needs-triage 31, bug 13, rust 9, tui/documentation/cleanup 5 each, tools/reliability/bot-authored 3 each, responses-api/agent-ready 2 each, subagents/question/model-lab/external-memory 1 each.

No human comment in more than 14 days: 90 (measured by the latest non-bot comment, or creation date if none).

Commands
gh issue list -R codewhale-hq/Codewhale --state open --limit 1000 --json number,labels,createdAt,comments,author   # 186
# idle = now - max(createdAt, non-bot comments) > 14d -> 90 (12 non-Hmbown)
gh api search/issues -f q='repo:codewhale-hq/Codewhale is:issue created:>=2026-09-28'  # 42 ; closed:>=2026-09-28 -> 32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bot-authoredOpened by a bot or app account

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions