Skip to content

fix: use model aliases for pins Copilot no longer offers - #70342

Merged
SivaKesava1 merged 3 commits into
mainfrom
sivakesava1/model-pins-aliases
Oct 19, 2026
Merged

SivaKesava1 merged 3 commits into
mainfrom
sivakesava1/model-pins-aliases

Conversation

@SivaKesava1

Copy link
Copy Markdown
Collaborator

Around 18:00 UTC on 19 Oct, the Copilot catalogue that gh-aw workflows see (agentic-workflows integration, via AWF /reflect) dropped gpt-5-mini, gpt-5.4, gpt-5.4-mini, gpt-5.5 and grok-4.5, and shrank from 40 to 36 models. The change is consistent across every run sampled since then, and githubstatus.com shows no incident. Checked against main with the pin checker from #70295, 40 pins in about 35 workflows no longer resolve. Issue Monster's detection has already failed on gpt-5.4.

This PR switches the top-level model: of the 15 affected workflows whose engines resolve aliases (Copilot and Pi) to built-in aliases. An alias resolves to the newest live model at run time, so the next retirement doesn't break these workflows again. Each run still records the concrete model in model.resolution.

Before After Resolves to today Workflows
gpt-5.4, gpt-5.5 gpt-5 gpt-5.6-luna issue-monster, pr-code-quality-reviewer, cli-version-checker, daily-github-docs-seo-optimizer, daily-hippo-learn, daily-multi-device-docs-tester, smoke-copilot-sdk
gpt-5.4-mini, gpt-5-mini gpt-5 gpt-5.6-luna daily-model-resolution, dependabot-burner, hippo-embed, repo-tree-map, smoke-temporary-id, sub-issue-closer, daily-credit-limit-test
grok-4.5 grok grok-4.7 daily-news

Provider prefixes (copilot/) are kept as they were.

Why gpt-5 for the mini pins. No GPT mini model is left, so the built-in gpt-5-mini alias no longer resolves either. small would resolve to claude-haiku-5.5, which moves these workflows to another model family. That is a risk for daily-model-resolution and dependabot-burner, which have sub-agents. gpt-5 keeps the family and the /responses API these workflows already used. It is also cheaper than gpt-5.4-mini per the bundled catalogue (input $0.20 vs $0.75 per million tokens). Routed smokes ran on gpt-5.6-luna today under Copilot CLI, the Copilot SDK and Pi.

Lock files. Recompiled with gh aw built from main (1215c14345). The lock diffs contain only the model values, the frontmatter hashes and the compile-time cost entries (which are dropped for alias pins, as for other alias pins). main has not moved since.

Not in this PR. These pins need exact ids, so choosing replacements needs a follow-up:

  • engine.fallback-models (8 pins): aliases fail compilation.
  • model-routing.allowed-models (1): exact names only.
  • Copilot inline sub-agent models (4): not alias-resolved.
  • aider, crush, goose, opencode, pydantic-ai and deepseek workflows (8): these engines don't resolve aliases. They also use /chat/completions, which no live GPT model serves any more (only Claude does).
  • Smokes that assert exact sub-agent models.
  • video-analyzer (Gemini): there is no Gemini model for this integration.

Around 18:00 UTC on 19 Oct the Copilot catalogue for gh-aw workflows
dropped gpt-5-mini, gpt-5.4, gpt-5.4-mini, gpt-5.5 and grok-4.5. Switch
the top-level model of 15 workflows to built-in aliases, which resolve
to the newest live model at run time, so the next retirement does not
break them again:

- gpt-5.4, gpt-5.5, gpt-5.4-mini, gpt-5-mini -> gpt-5 (gpt-5.6-luna
  today; same family and /responses API, cheaper than gpt-5.4-mini).
  The gpt-5-mini alias itself no longer resolves.
- grok-4.5 -> grok (grok-4.7 today).

Provider prefixes are kept. Fallback models, routing allowed-models,
Copilot sub-agent models and engines without alias support need exact
ids and are not changed here.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

The CLI version checker contract test still requires the retired model pin and must be updated to match the new alias.

1 open issue
What changed in this PR

Replaces retired model pins in gh-aw’s Copilot and Pi workflows with runtime-resolved aliases.

Changes:

  • Switch 14 workflows to gpt-5 and daily-news to grok, preserving provider prefixes.
  • Refresh six generated lock files with matching runtime settings and metadata.
File Description
.github/​workflows/​sub-issue-closer.md Use GPT alias for issue closure.
.github/​workflows/​smoke-temporary-id.md Use GPT alias for temporary-ID smoke.
.github/​workflows/​smoke-copilot-sdk.md Use GPT alias for SDK smoke.
.github/​workflows/​smoke-copilot-sdk.lock.yml Refresh SDK smoke execution settings.
.github/​workflows/​repo-tree-map.md Use GPT alias for tree mapping.
.github/​workflows/​repo-tree-map.lock.yml Refresh Pi model resolution and metadata.
.github/​workflows/​pr-code-quality-reviewer.md Use GPT alias for code reviews.
.github/​workflows/​issue-monster.md Use GPT alias for Issue Monster.
.github/​workflows/​hippo-embed.md Use GPT alias for embedding automation.
.github/​workflows/​hippo-embed.lock.yml Refresh Pi model resolution and metadata.
.github/​workflows/​dependabot-burner.md Use GPT alias for dependency automation.
.github/​workflows/​daily-news.md Replace Grok pin with its alias.
.github/​workflows/​daily-multi-device-docs-tester.md Use GPT alias for device testing.
.github/​workflows/​daily-model-resolution.md Use GPT alias for resolution audits.
.github/​workflows/​daily-model-resolution.lock.yml Refresh audit execution settings.
.github/​workflows/​daily-hippo-learn.md Use GPT alias for learning automation.
.github/​workflows/​daily-github-docs-seo-optimizer.md Use GPT alias for SEO analysis.
.github/​workflows/​daily-github-docs-seo-optimizer.lock.yml Refresh agent, detection, and evaluation settings.
.github/​workflows/​daily-credit-limit-test.md Use GPT alias for credit-limit testing.
.github/​workflows/​daily-credit-limit-test.lock.yml Refresh credit-test execution settings.
.github/​workflows/​cli-version-checker.md Use GPT alias for version monitoring.

Review effort: Max

Comment thread .github/workflows/cli-version-checker.md
TestCLIVersionCheckerUsesCopilotModel asserted the retired copilot/gpt-5.5
pin. Match the new alias as a whole line so a gpt-5.x pin can't satisfy it.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@SivaKesava1

Copy link
Copy Markdown
Collaborator Author

Verification at 01583d88b6:

  • Copilot code review: one finding. TestCLIVersionCheckerUsesCopilotModel still expected copilot/gpt-5.5. Fixed in 01583d88b6; the test now matches the whole model: copilot/gpt-5 line (passes with the alias, fails with the old pin). The thread is resolved.
  • Other tests: no other Go or JS test asserts a changed model: line. go test ./pkg/cli -run Contract passes, as do the related pkg/workflow tests. Go tests don't run on PRs here, so these were run locally at this commit.
  • Checks: the stale lock-file check, code scanning and license checks pass.
  • Smokes on this branch:
    • smoke-copilot-sdk (39312833467): success with copilot/gpt-5.
    • smoke-temporary-id on Pi (39312838590): the alias resolved and was confirmed live (model resolution: engine=pi role=main configured=copilot/gpt-5 resolved=gpt-5.6-luna provider=copilot status=resolved). The run ended failure for an unrelated, pre-existing reason: add_comment has no target on workflow_dispatch. The last run on main (39180216318, before this change) failed the same way.
  • Catalogue: unchanged at 19:15 UTC (36 Copilot models, no gpt-5.4, gpt-5.4-mini, gpt-5.5, gpt-5-mini or grok-4.5).

Ready to merge.

@SivaKesava1
SivaKesava1 merged commit 9bf555c into main Oct 19, 2026
35 checks passed
@SivaKesava1
SivaKesava1 deleted the sivakesava1/model-pins-aliases branch October 19, 2026 20:14
@github-actions

Copy link
Copy Markdown
Contributor

🎉 This pull request is included in a new release.

Release: v0.92.6

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants