Repository navigation
fix: replace retired model pins in three workflows - #70328
Merged
Merged
Conversation
Copilot no longer offers claude-opus-4.8, gpt-5-nano or claude-sonnet-4.6. - daily-action-setup-security-audit: claude-opus-4.8 -> opus (built-in alias, newest live Opus). Since 17 Oct the Copilot SDK harness has run this workflow on claude-haiku-4.5 instead (#70317), and its threat detection failed on the retired model (#70316). - smoke-copilot-sub-agents: the nano-whoami sub-agent (gpt-5-nano) becomes mini54-whoami on gpt-5.4-mini, a live small model on /responses; Copilot offers no nano model. - smoke-github-claude: the second fallback model claude-sonnet-4.6 becomes claude-sonnet-5.5 (fallback-models must be concrete ids). Found by the workflow model-pin check (#70289, #70312). Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
There was a problem hiding this comment.
🟡 Changes recommended
The sub-agent rename leaves its companion fixture stale, causing two success-path tests to fail.
1 open issue
What changed in this PR
Replaces retired Copilot model pins identified by the inventory checker in gh-aw’s audit and smoke workflows.
Changes:
- Uses the
opusalias for the security audit. - Replaces the nano sub-agent with
gpt-5.4-miniand updates its assertions. - Updates the Claude fallback to Sonnet 5.5 and regenerates all three lock files.
| File | Description |
|---|---|
.github/workflows/smoke-github-claude.md |
Updates the concrete fallback model. |
.github/workflows/smoke-github-claude.lock.yml |
Reflects the fallback and cost changes. |
.github/workflows/smoke-copilot-sub-agents.md |
Updates the sub-agent identity, model, and assertions. |
.github/workflows/smoke-copilot-sub-agents.lock.yml |
Reflects the updated sub-agent configuration. |
.github/workflows/daily-action-setup-security-audit.md |
Replaces the retired Opus pin with an alias. |
.github/workflows/daily-action-setup-security-audit.lock.yml |
Propagates the alias to agent, detection, and evaluations. |
Review effort: Max
| ["haiku-whoami", "claude-haiku-4.5", "/chat/completions"], | ||
| ["mini-whoami", "gpt-5-mini", "/responses"], | ||
| ["nano-whoami", "gpt-5-nano", "/responses"], | ||
| ["mini54-whoami", "gpt-5.4-mini", "/responses"], |
SivaKesava1
added a commit
that referenced
this pull request
Oct 19, 2026
…70355) #70328 renamed the nano-whoami sub-agent in smoke-copilot-sub-agents.md to mini54-whoami (gpt-5.4-mini), but smoke_copilot_sub_agents.test.cjs still built evidence for nano-whoami, so two tests fail on main and in every PR's JS shards. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
|
🎉 This pull request is included in a new release. Release: |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Copilot no longer offers
claude-opus-4.8,gpt-5-nanoorclaude-sonnet-4.6, and three gh-aw workflows still pinned them. The new workflow model-pin check (#70289, PR #70295) found them; its first report is #70312.Changes
daily-action-setup-security-audit.mdmodelclaude-opus-4.8opuscopilot/*opus*), resolves to the newest live Opus (claude-opus-5.5today) and follows future Opus releases. Since 17 Oct the Copilot SDK harness has silently run this workflow onclaude-haiku-4.5(#70317), and its threat detection failed on the retired model on every run (#70316). Detection inherits the main model, so this also restores the detection verdict.smoke-copilot-sub-agents.mdnano-whoamiongpt-5-nanomini54-whoamiongpt-5.4-minigpt-5.4-miniis a live small model on/responses, so the smoke still covers three distinct sub-agent models and both wire APIs. The smoke asserts exact served models, so an alias is not suitable here.smoke-github-claude.mdengine.fallback-models[1]copilot/claude-sonnet-4.6copilot/claude-sonnet-5.5fallback-modelsmust be concrete ids.Lock files were recompiled with
gh awbuilt frommain(d5ecd72bf9). The lock diffs contain only the model values, the frontmatter hashes, and the compile-time cost entry (dropped for theopusalias, as for other alias pins such assmoke-copilot-small).Checked
claude-opus-5.5,gpt-5.4-mini(/responses) andclaude-sonnet-5.5, and no Opus 4.8, nano model or Sonnet 4.6.smoke-copilot-smallusessmall, anddaily-code-metricsusescopilot/autoin SDK mode). In SDK mode the harness resolves the alias before choosing the SDK provider model.Not changed
video-analyzer.mdpinscopilot/gemini-3.7-flash. The Copilot catalogue for this integration has no Gemini model, but replacing it with a non-Gemini model would change what a video-analysis workflow can do, so that needs the owner's decision. It is dispatch-only and last ran in July.