Skip to content

Pull requests: pytorch/rl

New pull request New
104 Open 3,071 Closed
104 Open 3,071 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Feature] Sequence sample unit with exact boundary policies CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation ReplayBuffers Trainers
#4050 opened Jul 25, 2026 by coder-jayp Contributor Loading…
4 of 6 tasks
1
[Feature] Implement Compare-Version facility for update_if_present Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature ReplayBuffers
#4049 opened Jul 25, 2026 by coder-jayp Contributor Loading…
4 of 6 tasks
1
[Test] Add automated Config/Class kwarg-parity checks for Hydra configs CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Tests Incomplete or broken unit tests Trainers
#4048 opened Jul 25, 2026 by theap06 Contributor Loading…
1
[Feature] Add generation-stamped replay slots for round-robin writer CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature ReplayBuffers
#4046 opened Jul 24, 2026 by harryfrzz • Draft
4 of 6 tasks
6
[Feature] Add SampleUnit composition point for replay sampling CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature ReplayBuffers Trainers
#4045 opened Jul 24, 2026 by theap06 Contributor Loading…
1
[CI] Let contributors self-assign issues via /assign CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#4044 opened Jul 24, 2026 by theap06 Contributor Loading…
1 of 2 tasks
1
[Feature] Add ReplayBuffer.update_if_present for generation-safe conditional updates Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature ReplayBuffers
#4043 opened Jul 24, 2026 by theap06 Contributor • Draft
1
[Feature] Add DistillationLoss for token-level LLM knowledge distillation CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives
#4038 opened Jul 21, 2026 by theap06 Contributor Loading…
1
Bump torch from 2.12.0 to 2.13.0 in /sota-implementations/expert-iteration CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Dependencies Pull requests that update a dependency file python Pull requests that update python code sota-implementations/
#4037 opened Jul 17, 2026 by dependabot Bot Loading…
2
[Performance] Avoid parent env construction in ParallelEnv startup Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Performance Performance issue or suggestion for improvement sota-implementations/
#4029 opened Jul 16, 2026 by vmoens Collaborator • Draft
3
[Performance] Eliminate parent LIBERO environment construction Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Performance Performance issue or suggestion for improvement sota-implementations/
#4028 opened Jul 16, 2026 by vmoens Collaborator Loading…
1
[BugFix] Stage collector weight sync through CPU when device sharing … BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Integrations/torch_geometric Integrations WeightUpdate
#4027 opened Jul 16, 2026 by theap06 Contributor Loading…
1
1
[Test] Add off-policy data-parallel learning suite CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. sota-implementations/ Tests Incomplete or broken unit tests Trainers
#4026 opened Jul 16, 2026 by vmoens Collaborator • Draft
1
[Feature] Add reliable VLA-GRPO LIBERO recipe CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives sota-implementations/ Transforms
#4024 opened Jul 16, 2026 by vmoens Collaborator • Draft
2
[Feature] Add flat replay writes to collectors Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Documentation Improvements or additions to documentation Feature New feature Integrations/torch_geometric Integrations Trainers
#4020 opened Jul 16, 2026 by vmoens Collaborator Loading…
1
[BugFix] Bound direct off-policy replay collection BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Integrations/torch_geometric Integrations ReplayBuffers Trainers
#4018 opened Jul 16, 2026 by vmoens Collaborator Loading…
1
[LLM] WS4 Post-Training Observability: Implement PostTrainingLogger CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation llm/ LLM-related PR, triggers LLM CI tests Objectives Record sota-implementations/
#3950 opened Jul 7, 2026 by coder-jayp Contributor Loading…
7 of 8 tasks
1
3
[Feature] Add Learner primitive (LocalLearner, FSDP2Learner) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature Trainers
#3926 opened Jul 2, 2026 by theap06 Contributor Loading…
1
[Algorithm] Add RLHF reward-model training recipe CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation llm/ LLM-related PR, triggers LLM CI tests new algo New algorithm request or PR Objectives sota-implementations/
#3923 opened Jun 30, 2026 by theap06 Contributor Loading…
4
[Feature] Add RewardModelLoss objective for RLHF reward-model training CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives
#3922 opened Jun 30, 2026 by theap06 Contributor Loading…
2
[Feature] On-policy KL distillation loss for LLMs CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives
#3921 opened Jun 30, 2026 by theap06 Contributor Loading…
2
[Feature] Tensorclass support for IQLLoss CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature Objectives
#3864 opened Jun 13, 2026 by aehebald Loading…
4 of 6 tasks
4
[BugFix] Set "next" obs to current if native_autoreset BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments/gym Environments Adds or modifies an environment wrapper Transforms
#3786 opened May 21, 2026 by lin-erica Contributor Loading…
3 of 10 tasks
1
[Feature] Collector final_obs: store true boundary next-obs for shifted-GAE CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Feature New feature Integrations/torch_geometric Integrations Objectives ReplayBuffers
#3758 opened May 15, 2026 by vmoens Collaborator Loading…
2
[Feature] MCP and HTTP tools, agentic tutorial, see-also pointers CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests tutorials/
#3737 opened May 10, 2026 by vmoens Collaborator Loading…
1
ProTip! What’s not been updated in a month: updated:<2026-06-25.