Skip to content

Pull requests: pytorch/rl

New pull request New
97 Open 3,070 Closed
97 Open 3,070 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Feature] Add DistillationLoss for token-level LLM knowledge distillation CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives
#4038 opened Jul 21, 2026 by theap06 Contributor Loading…
1
Bump torch from 2.12.0 to 2.13.0 in /sota-implementations/expert-iteration CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Dependencies Pull requests that update a dependency file python Pull requests that update python code sota-implementations/
#4037 opened Jul 17, 2026 by dependabot Bot Loading…
2
[Performance] Avoid parent env construction in ParallelEnv startup Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Performance Performance issue or suggestion for improvement sota-implementations/
#4029 opened Jul 16, 2026 by vmoens Collaborator • Draft
3
[Performance] Eliminate parent LIBERO environment construction Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Performance Performance issue or suggestion for improvement sota-implementations/
#4028 opened Jul 16, 2026 by vmoens Collaborator Loading…
1
[BugFix] Stage collector weight sync through CPU when device sharing … BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Integrations/torch_geometric Integrations WeightUpdate
#4027 opened Jul 16, 2026 by theap06 Contributor Loading…
1
1
[Test] Add off-policy data-parallel learning suite CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. sota-implementations/ Tests Incomplete or broken unit tests Trainers
#4026 opened Jul 16, 2026 by vmoens Collaborator • Draft
1
[Feature] Add reliable VLA-GRPO LIBERO recipe CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives sota-implementations/ Transforms
#4024 opened Jul 16, 2026 by vmoens Collaborator • Draft
2
[Feature] Add flat replay writes to collectors Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Documentation Improvements or additions to documentation Feature New feature Integrations/torch_geometric Integrations Trainers
#4020 opened Jul 16, 2026 by vmoens Collaborator Loading…
1
[BugFix] Bound direct off-policy replay collection BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Integrations/torch_geometric Integrations ReplayBuffers Trainers
#4018 opened Jul 16, 2026 by vmoens Collaborator Loading…
1
[LLM] WS4 Post-Training Observability: Implement PostTrainingLogger CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation llm/ LLM-related PR, triggers LLM CI tests Objectives Record sota-implementations/
#3950 opened Jul 7, 2026 by coder-jayp Contributor Loading…
7 of 8 tasks
1
3
[Feature] Add Learner primitive (LocalLearner, FSDP2Learner) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature Trainers
#3926 opened Jul 2, 2026 by theap06 Contributor Loading…
1
[Algorithm] Add RLHF reward-model training recipe CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation llm/ LLM-related PR, triggers LLM CI tests new algo New algorithm request or PR Objectives sota-implementations/
#3923 opened Jun 30, 2026 by theap06 Contributor Loading…
4
[Feature] Add RewardModelLoss objective for RLHF reward-model training CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives
#3922 opened Jun 30, 2026 by theap06 Contributor Loading…
2
[Feature] On-policy KL distillation loss for LLMs CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives
#3921 opened Jun 30, 2026 by theap06 Contributor Loading…
2
[Feature] Tensorclass support for IQLLoss CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature Objectives
#3864 opened Jun 13, 2026 by aehebald Loading…
4 of 6 tasks
4
[BugFix] Set "next" obs to current if native_autoreset BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments/gym Environments Adds or modifies an environment wrapper Transforms
#3786 opened May 21, 2026 by lin-erica Contributor Loading…
3 of 10 tasks
1
[Feature] Collector final_obs: store true boundary next-obs for shifted-GAE CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Feature New feature Integrations/torch_geometric Integrations Objectives ReplayBuffers
#3758 opened May 15, 2026 by vmoens Collaborator Loading…
2
[Feature] MCP and HTTP tools, agentic tutorial, see-also pointers CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests tutorials/
#3737 opened May 10, 2026 by vmoens Collaborator Loading…
1
[Feature] ToolCompose with parallel dispatch, builtin tools, legacy adapter Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature llm/ LLM-related PR, triggers LLM CI tests
#3736 opened May 10, 2026 by vmoens Collaborator Loading…
1
[Feature] Agentic toolkit foundation: protocols, parsers, sandbox, REPL CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests
#3735 opened May 10, 2026 by vmoens Collaborator Loading…
12
[Feature] Add functorch integration tests for TensorDictModule - Fixes #154 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature Modules
#3697 opened Apr 30, 2026 by ParamThakkar123 Contributor Loading…
1
2
[CI] Add ruleset JSON requiring lint-done on protected branches CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#3690 opened Apr 28, 2026 by vmoens Collaborator Loading…
3 tasks
3
[CI] Selective PR test matrix gated by changed-files + ciflow/* labels CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#3674 opened Apr 27, 2026 by vmoens Collaborator Loading…
4 of 8 tasks
3
[CI] Install torchcodec from source CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Record
#3541 opened Mar 4, 2026 by vmoens Collaborator Loading…
1
[Feature] Added Lazy implementation of priority updates for replaybuffer prototype CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature ReplayBuffers
#3507 opened Feb 13, 2026 by ParamThakkar123 Contributor Loading…
3 of 10 tasks
1
3
ProTip! Updated in the last three days: updated:>2026-07-19.