Repository navigation
PERF: Prepare scenarios on the backend event loop - #3046
Open
Richard Lundeen (richlundeen) wants to merge 7 commits into
Open
Richard Lundeen (richlundeen) wants to merge 7 commits into
Richard Lundeen (richlundeen) wants to merge 7 commits into
Conversation
Retain serialized preparation and abandoned admission cleanup, offload blocking construction, and preserve runtime shutdown ownership. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 8fabc130-e568-4583-9ff0-ec26491a6414
Keep upstream statistics and async-generator typing while removing the preparation executor. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 8fabc130-e568-4583-9ff0-ec26491a6414
Richard Lundeen (richlundeen)
changed the title
Preserve external parameter validation and off-loop scenario discovery. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 8fabc130-e568-4583-9ff0-ec26491a6414
Offload matrix, template, and converter construction while keeping async dataset reads and persistence on the backend loop. Cover a real seven-dataset RapidResponse launch and template reads for ManyShot, Crescendo, TAP, and Skeleton Key. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 8fabc130-e568-4583-9ff0-ec26491a6414
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 8fabc130-e568-4583-9ff0-ec26491a6414
Roman Lutz (romanlutz)
approved these changes
Oct 10, 2026
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 8fabc130-e568-4583-9ff0-ec26491a6414
Richard Lundeen (richlundeen)
enabled auto-merge
October 10, 2026 22:59
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 8fabc130-e568-4583-9ff0-ec26491a6414
github-merge-queue
Bot
removed this pull request from the merge queue due to failed status checks
Oct 10, 2026
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Prepare and execute scenarios on one backend event loop so async memory resources stay valid and the backend remains responsive.
We removed the preparation executor, temporary event loop, and per-launch memory disposal while preserving serialized preparation and FIFO execution. We moved blocking construction off-loop and retained cleanup for requests cancelled before scheduler admission, without changing HTTP disconnect shielding or runs already owned by the scheduler. We added regression coverage for cancellation during admission, construction responsiveness, shared SQLite loop resources, and shutdown ordering.