test: fix some bugs in benchmark tests + add three more

[danielroe]

🔗 Linked issue

📚 Description

[coderabbitai]

Warning

Review limit reached

Next included review available in 37 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used all 2 included reviews currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Advanced

Run ID: e51a277c-a031-48ac-9ad7-7c93988f003f

📥 Commits

Reviewing files that changed from the base of the PR and between 99135a6 and c40bdf4.

📒 Files selected for processing (6)

• bench/lib/targets.ts
• bench/run.ts
• bench/suites/dev.ts
• bench/suites/panel.ts
• capture/lib/fixture.ts
• capture/record.ts

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[pkg-pr-new]

• nuxt-cli-playground

  npm i https://pkg.pr.new/create-nuxt@1550
  

  npm i https://pkg.pr.new/nuxi@1550
  

  npm i https://pkg.pr.new/@nuxt/cli@1550
  

commit: c40bdf4

[github-actions]

CLI benchmark

@nuxt/cli v4.0.0-alpha.1 (baseline) vs v4.0.0-alpha.1 (this PR)

Metric	baseline v4.0.0-alpha.1	head v4.0.0-alpha.1	Delta
nuxt --version wall time (median)	66 ms	65 ms	-1.8%
nuxt --help wall time (median)	144 ms	143 ms	-0.7%
nuxt dev --help wall time (median)	111 ms	109 ms	-2.4%
nuxt --version modules loaded	37	37	0.0%
nuxt --help modules loaded	139	139	0.0%
nuxt dev --help modules loaded	82	82	0.0%
Installed node_modules	2.37 MB	2.37 MB	-0.0%
Published tarball (packed)	229.0 kB	229.0 kB	0.0%

Full report

@nuxt/cli v4.0.0-alpha.1 (baseline) vs v4.0.0-alpha.1 (head)

Setting	Value
Baseline	ref:99135a6c1e64b98f38cf23913f8938ce3ac0c400 (v4.0.0-alpha.1)
Head	local packages/nuxt-cli at 2bcb5ab (v4.0.0-alpha.1)
Node	v24.21.0
OS	Linux 6.17.0 (kernel 6.17.0-1022-azure)
CPU	AMD EPYC 7763 64-Core Processor x 4
Memory	15.6 GB
Load average at start	0.91, 0.27, 0.10
Run started	2026-09-21T22:34:18.167Z

Cold CLI startup

Median of 15 interleaved runs per command, one warmup discarded.

Command	baseline v4.0.0-alpha.1 median	head v4.0.0-alpha.1 median	Delta	baseline v4.0.0-alpha.1 min / p95	head v4.0.0-alpha.1 min / p95
nuxt --version	66 ms	65 ms	-1.8%	63 ms / 69 ms	63 ms / 70 ms
nuxt --version (first output byte)	62 ms	61 ms	-1.8%	59 ms / 65 ms	59 ms / 66 ms
nuxt --help	144 ms	143 ms	-0.7%	141 ms / 152 ms	139 ms / 152 ms
nuxt --help (first output byte)	139 ms	138 ms	-0.5%	136 ms / 147 ms	134 ms / 146 ms
nuxt dev --help	111 ms	109 ms	-2.4%	103 ms / 115 ms	103 ms / 117 ms
nuxt dev --help (first output byte)	107 ms	104 ms	-2.8%	99 ms / 110 ms	99 ms / 111 ms
nuxt <unknown-command> (no-op)	154 ms	156 ms	+1.2%	151 ms / 165 ms	149 ms / 162 ms
nuxt <unknown-command> (no-op) (first output byte)	148 ms	150 ms	+1.3%	145 ms / 159 ms	143 ms / 156 ms

Module load cost

Counted with a module.registerHooks load hook, compile cache disabled. Counts every JS module actually evaluated on that code path (built-ins excluded, native addons excluded).

Command	baseline v4.0.0-alpha.1 modules	head v4.0.0-alpha.1 modules	Delta	baseline v4.0.0-alpha.1 source bytes	head v4.0.0-alpha.1 source bytes	Delta
nuxt --version	37	37	0.0%	302.3 kB	302.3 kB	0.0%
nuxt --help	139	139	0.0%	1.03 MB	1.03 MB	0.0%
nuxt dev --help	82	82	0.0%	644.4 kB	644.4 kB	0.0%

Install footprint and published tarball

Each version installed on its own into an empty project with nothing but @nuxt/cli as a dependency, so the tree is exactly the CLI and its transitive dependencies. npm cache is warm and the registry is only consulted for metadata, so install wall time is indicative, not a network benchmark.

Metric	baseline v4.0.0-alpha.1	head v4.0.0-alpha.1	Delta
Direct dependencies of @nuxt/cli	22	22	0.0%
Packages in the installed tree (unique name@version)	38	38	0.0%
Unique package names	38	38	0.0%
Package directories on disk (cross-check)	31	31	0.0%
Installed node_modules on disk	2.37 MB	2.37 MB	-0.0%
Installed files	407	407	0.0%
Install wall time (warm npm cache, median of 3)	1.28 s	1.28 s	-0.5%
Published tarball (packed)	229.0 kB	229.0 kB	0.0%
Published tarball (unpacked)	748.3 kB	748.3 kB	0.0%
Files in tarball	84	84	0.0%

Interleaved runs on a shared runner: trust the deltas, not the absolute timings. The dev, restart and build suites run locally via pnpm bench:cli.

[codspeed]

Merging this PR will not alter performance

✅ 2 untouched benchmarks

---

_{Comparing test/bench-fixes (c40bdf4) with main (000c43c)¹}

Footnotes

1. No successful run was found on main (99135a6) during the generation of this report, so 000c43c was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩