Skip to content

test(evals): add eval cases for pointer-swept skills that have none - part 1 of 9 #13303

Description

@melodic-automation-lanes

Part 1 of 9 of #13300, split at intake (owner Q93). The done-when below is copied from #13300 as written.

Done when

  • instruction-placement migrate, audit, delta

Activity

  1. added
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Nov 4, 2026
  2. github-actions commented on Nov 4, 2026

    @github-actions
    Contributor

    Proposed work class: work-class: scoped
    Basis: automated intake triage; the lanes App applied this class.

    Size: Small
    Complexity: Low
    Uncertainty: Known
    Flags: none
    Blocked by: none

    Understood: this is part 1 of 9 of #13300, split at intake. It asks for eval cases for the instruction-placement skills migrate, audit and delta, which have none today. The done-when is a single checklist item. The siblings (#13304 to #13311) cover the other parts, so this is not a duplicate. Nothing is missing.

    Automated triage, applied by the lanes App.

  3. added
    priority: mediumReal value, no hard deadline; normal backlog flow.
    and removed
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Nov 4, 2026
  4. added
    status: readyTriaged, unblocked, and fully specified; eligible to pick up.
    work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.
    on Nov 4, 2026
  5. added
    admission-deferredAdmitted but waiting for WIP room; the hourly work-unblock sweep labels it agent-ready.
    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.
    and removed
    admission-deferredAdmitted but waiting for WIP room; the hourly work-unblock sweep labels it agent-ready.
    on Nov 4, 2026
  6. github-actions commented on Nov 4, 2026

    @github-actions
    Contributor
    No description provided.
  7. github-actions commented on Nov 4, 2026

    @github-actions
    Contributor
    No description provided.
  8. self-assigned this
    on Nov 4, 2026
  9. kyle-sexton commented on Nov 4, 2026

    @kyle-sexton
    Member
    No description provided.
  10. kyle-sexton commented on Nov 4, 2026

    @kyle-sexton
    Member
    No description provided.
  11. kyle-sexton commented on Nov 4, 2026

    @kyle-sexton
    Member

    Delivered by #13318, merged 2026-11-04T19:17:16Z as b741bab. Its body opens with Closes #13303 and GitHub lists this issue in its closing references, but the merge left the issue open, the same as #13191 and PR #13338 (cause not determined).

    Done-when check on main: plugins/instruction-placement/evals/ holds mg-plan-stops-before-write (migrate), au-safety-rail-held-back (audit) and dl-no-baseline-routes-to-audit (delta). The PR's 'Not verified' step is now run: validate-cases.py plugins/instruction-placement/evals exits 0 with 0 FAIL lines. Its WARN lines are the allowed_tools note every Bash case carries; runs pass --allow-tools.

  12. removed
    status: readyTriaged, unblocked, and fully specified; eligible to pick up.
    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.
    on Nov 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

priority: mediumReal value, no hard deadline; normal backlog flow.work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.

Type

Fields

Work status

agent-ready

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions