Skip to content

fix(evalboard): list date-named runs flagged adhoc in the Ad-hoc section - #200

Merged
bai-uipath merged 1 commit into
mainfrom
bai/evalboard-adhoc-dated-runs
Sep 25, 2026
Merged

bai-uipath merged 1 commit into
mainfrom
bai/evalboard-adhoc-dated-runs

Conversation

@bai-uipath

Copy link
Copy Markdown
Collaborator

Motivation

  • The two 2026-09-25 nightlies ran with no skills loaded (skills #3546, reverted in #3564). I set adhoc: true in their meta.json. They left the main table, but they are also missing from the Ad-hoc section, so the front page does not show them at all.
  • Cause: getAdhocRunListing only lists ids that are not date-shaped. The main table drops date-shaped runs that are flagged adhoc. A date-named run with the flag is in neither list.

Changes

  • getAdhocRunListing also takes the 30d window of daily runs, keeps the ones with meta.json adhoc: true, and adds them to the rows. The overview already loads these per-run projections, so the extra load is a cache hit.
  • Limit: a flagged date-named run older than 30 days is still not listed. Its /runs/<id> page still works.

Validation

Check Result
make evalboard-verify (tsc, vitest, next build) pass, 815/815 tests
Local next start against the coderevaltests/runs container both BAD RUN: … rows show in Ad-hoc, between adhoc-2026-09-25_15-37-22 and adhoc-2026-09-24_23-20-37, and not in the main table

🤖 Generated with Claude Code

A date-named run with meta.json adhoc=true was dropped from the main table,
and the Ad-hoc section only listed ids that are not date-shaped, so the run
was missing from the front page.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@bai-uipath
bai-uipath marked this pull request as ready for review September 25, 2026 17:39
@github-actions

github-actions Bot commented Sep 25, 2026 •

Copy link
Copy Markdown

Claude finished @bai-uipath's task in 1m 47s —— View job


Review in Progress

Todo List:

  • Read .github/code_review.md for review standards
  • Read CLAUDE.md for project conventions
  • View the full PR diff
  • Read the full evalboard/lib/overview.ts file for context
  • Check cross-file consistency
  • Analyze what might be missing
  • Provide structured review feedback

@bai-uipath
bai-uipath merged commit 5bf4a72 into main Sep 25, 2026
19 checks passed
@bai-uipath
bai-uipath deleted the bai/evalboard-adhoc-dated-runs branch September 25, 2026 18:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant