Skip to content

Document intentional Renovate exclusions in AGENTS.md to prevent false-positive config proposals #3458

Description

@fullsend-ai-retro

What happened

The retro agent analyzed autoclosed Renovate PR #3340 (Go 1.25.8 → 1.26.4, only .tool-versions updated) and filed issue #3360 proposing to add a missing "go version" group to the Renovate config. The triage agent marked it ready-to-code (run 28263961328), the code agent created PR #3361 (run 28264235361), and the review agent approved with ready-for-merge (run 28264534145). A human reviewer (simonbaird) also approved. Then maintainer st3penta clarified that Go updates were disabled on purpose to reduce noise, and the PR was closed without merge after 39 days. The repo's AGENTS.md contains no documentation about Renovate configuration decisions or intentional dependency management choices, and renovate.json simply extends the org-level preset without any local comments explaining the strategy.

What could go better

The repo has zero documentation about its Renovate strategy. Without this context, agents cannot distinguish between "missing config" (a bug) and "deliberately omitted config" (a design choice). The retro agent's technical analysis was sound — org-level config comments genuinely referenced a "go version" group that didn't exist — but the absence was intentional. All four agents in the pipeline (retro, triage, code, review) lacked the context to recognize this. Adding a brief note to AGENTS.md about intentional Renovate exclusions would provide all agents with the signal needed to avoid this class of false positive. This is complementary to the systemic improvements tracked in fullsend-ai/fullsend #2478 and #3912 — even with better uncertainty flagging and confidence-based routing, agents still need repo-specific context to make correct judgments about intentional configuration. Confidence: high that this gap contributed to the wasted work; medium that agents will consistently apply the guidance, since it depends on them reading the relevant AGENTS.md section during analysis.

Proposed change

Add a "Dependency management" section to AGENTS.md documenting: (1) Go language version updates are intentionally managed manually, not via Renovate automation — the team deliberately disabled automated Go version bumps at the org level to reduce PR noise and maintain full control over Go version transitions. (2) Agents should not propose re-enabling automated Go version updates or adding Renovate package rules for Go version grouping. (3) The org-level Renovate config at conforma/.github excludes Go-related packages from automated groups by design, even though config comments reference a "go version" group that was never implemented. This should be 3-5 sentences placed near the existing build/test documentation in AGENTS.md.

Validation criteria

No new retro-originated issues proposing Go version Renovate config changes should appear in conforma/cli within the next 90 days. If another Renovate Go version PR triggers a retro run, the retro agent should reference the AGENTS.md guidance and refrain from filing a config change proposal. Additionally, issue #3360 should be closed by a maintainer as part of the cleanup.


Generated by retro agent from #3361

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions