Skip to content

test(eval): field-pattern regression fixture with xfail-tracked coverage gaps (6F.2)#44

Merged
officialCodeWork merged 1 commit into
developmentfrom
build/phase-6f/step-6f.2-field-patterns
Jul 15, 2026
Merged

test(eval): field-pattern regression fixture with xfail-tracked coverage gaps (6F.2)#44
officialCodeWork merged 1 commit into
developmentfrom
build/phase-6f/step-6f.2-field-patterns

Conversation

@officialCodeWork

Copy link
Copy Markdown
Owner

Summary

Closes the fixture-vs-reality blind spot the 2026-07-15 field validation exposed: every gate scored 1.000 while the real-codebase run got 28% instance resolution, 0 RTK data sources, and 0 route nodes. This fixture (eval/fixtures/field-patterns) replicates those exact shapes:

  • Two-hop barrel + rename (components/index.tsui/index.ts → definition) and tsconfig-path aliases (@ui, @store/*)
  • Loadable(lazy(() => import())) page elements
  • Route arrays in a separate file, spread-composed, passed to createBrowserRouter as an imported identifier
  • RTK Query storecreateApi base + two injectEndpoints slices (string-form and object-form query, a builder.mutation)
  • Tests through a custom renderWithProviders wrapper

Mechanism

The golden asserts target behavior. 9 checks the scanner can't satisfy yet carry expectedFail naming the enabling step — 6F.3 (DataGrid instances + blast radius), 6F.4 (endpoint attributions), 6F.5 (routes, effect, journey). The harness's unexpected-pass gate removes stale marks the moment a capability lands.

checks.ts change: xfail-marked attributions stay out of the lineage precision/recall tallies while marked — a known-missing capability shouldn't depress global metrics.

Confirmed by the scan

  • The @ui alias import yields no instance node at all for UsersPage's <Grid/> — matching the field's "72% never linked" diagnosis
  • 0 route / data-source / hook nodes
  • Already working (kept as passing checks): relative two-hop barrel rename, covered-by through the custom wrapper — so 6F.6 must find the actual field-breaking coverage variant

Verification

  • pnpm eval: 280 pass · 0 fail · 9 xfail · 0 unexpected-pass, gate OK, all metrics 1.000

🤖 Generated with Claude Code

…age gaps (6F.2)

New fixture eval/fixtures/field-patterns mirrors the shapes the 2026-07-15
ih-frontend validation used where every gate scored 1.000 but the field run
failed: tsconfig-path-alias barrel imports, Loadable(lazy(() => import()))
page elements, route arrays composed in a separate file and passed to
createBrowserRouter as an identifier, an RTK Query store, and tests rendering
through a custom providers wrapper.

Golden asserts target behavior; 9 checks the scanner cannot satisfy yet are
marked expectedFail naming the enabling step (6F.3 aliases/instances, 6F.4
RTK Query, 6F.5 object-config routes). Unexpected-pass gating removes stale
marks the moment a capability lands.

Scanning the fixture confirmed the field diagnosis: the @ui alias import
yields no instance node at all for UsersPage's <Grid/>, and 0
route/data-source/hook nodes exist. Relative two-hop barrel rename and
covered-by through the custom wrapper already work and stay as passing checks.

checks.ts: xfail-marked attributions no longer feed the lineage
precision/recall tallies while marked, so known-missing capabilities don't
depress global metrics.

Eval: 280 pass / 0 fail / 9 xfail / 0 unexpected-pass, gate OK, metrics 1.000.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@officialCodeWork
officialCodeWork merged commit 2f6973a into development Jul 15, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants