Skip to content

CI: retry flaky timing tests on Windows (ctest --repeat until-pass) - #1205

Merged
facontidavide merged 1 commit into
masterfrom
ci-windows-retry-flaky-tests
Sep 20, 2026
Merged

facontidavide merged 1 commit into
masterfrom
ci-windows-retry-flaky-tests

Conversation

@facontidavide

Copy link
Copy Markdown
Collaborator

The Windows and pixi-Windows jobs run behaviortree_cpp_test.exe once. Several tests assert tight wall-clock timing, and when a shared runner is slow a single one of them turns an unrelated PR red. Seen today on #1202 (twice, two different tests) and earlier on #1193:

  • RepeatTestAsync.RepeatTestAsync (windows-2022 Debug)
  • SequenceTripleActionTest.TripleAction (pixi windows-2022): 673 ms against a 660 ms budget

The macOS job already handles this with ctest --repeat until-pass:3 (and even excludes TripleAction). This PR makes the two Windows jobs run through ctest with the same retry. No test or library change; Linux jobs untouched, so real timing regressions still show up there.

CI-only change that can not be tested locally: the Windows jobs of this PR are the test.

🤖 Generated with Claude Code

The Windows and pixi-Windows jobs ran the gtest executable once, so a single
wall-clock timing test missing its budget on a loaded runner failed the whole
PR (RepeatTestAsync.RepeatTestAsync, SequenceTripleActionTest.TripleAction).
Use ctest --repeat until-pass:3, as the macOS job already does.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@sonarqubecloud

Copy link
Copy Markdown

@facontidavide
facontidavide merged commit cd536f0 into master Sep 20, 2026
17 checks passed
@facontidavide
facontidavide deleted the ci-windows-retry-flaky-tests branch September 20, 2026 13:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant