Skip to content

Pull requests: huggingface/trl

New pull request New
173 Open 4,298 Closed
173 Open 4,298 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Automatically label documentation and maintenance PRs 🔧 maintenance CI, tooling, tests, or repo upkeep
#7205 opened Sep 14, 2026 by albertvillanova Member Loading…
4
Align tiny Mistral v0.2 config with mistralai/Mistral-7B-Instruct-v0.2
#7204 opened Sep 14, 2026 by albertvillanova Member Loading…
3
Align tiny Mistral v0.1 config with mistralai/Mistral-7B-Instruct-v0.1
#7203 opened Sep 14, 2026 by albertvillanova Member Loading…
3
Reset the vLLM encoder cache after weight sync
#7200 opened Sep 13, 2026 by rmaguado Loading…
4 of 8 tasks
1
Reduce connection-pool warnings in the vLLM client
#7199 opened Sep 13, 2026 by vladbataev Loading…
5 of 7 tasks
1
[MFU] Use device peak flops instead of hardcoded H100's
#7197 opened Sep 13, 2026 by dwarez Loading…
4 of 8 tasks
12
Add selective activation checkpointing (SAC) to SFT
#7194 opened Sep 12, 2026 by kashif Collaborator Loading…
5 of 8 tasks
3
Bump the "github-actions-and-pre-commit" group with 2 updates across multiple ecosystems dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#7192 opened Sep 12, 2026 by dependabot Bot Loading…
3
docs: fix the clip explanation in the GRPO trainer page
#7190 opened Sep 12, 2026 by JiangLLM Loading…
4 of 8 tasks
[GRPO] Multiply the KL term by the per-token importance sampling ratio
#7188 opened Sep 11, 2026 by Alexander230 Loading…
4 of 6 tasks
1
[Exploratory] Drop accelerate launch: the CLI, docs and examples launch with torchrun
#7180 opened Sep 10, 2026 by qgallouedec Member • Draft
AsyncGRPO: cancel stale in-flight rollouts and survive generation fai…
#7176 opened Sep 10, 2026 by AmineDiro Member Loading…
8
[AsyncGRPO] Run sync tools on a thread pool and support async tools
#7175 opened Sep 10, 2026 by AmineDiro Member Loading…
5
fix: validate fractions in get_dataset to prevent ZeroDivisionError
#7164 opened Sep 10, 2026 by CJstate Loading…
5 of 6 tasks
1
Reject use_liger_kernel in GMPOTrainer
#7163 opened Sep 10, 2026 by YeonwooSung Contributor Loading…
5 of 8 tasks
1
Restore generation unwrap state if generate() raises
#7162 opened Sep 10, 2026 by YeonwooSung Contributor Loading…
4 of 8 tasks
1
Fail fast when GRPO combines Liger with the MoE auxiliary loss
#7161 opened Sep 10, 2026 by YeonwooSung Contributor Loading…
4 of 8 tasks
1
feat(grpo): add compute_metrics support to GRPOTrainer
#7144 opened Sep 9, 2026 by behroozazarkhalili Collaborator Loading…
4 of 5 tasks
1
3
feat: add activation_offloading to GRPOTrainer and RLOOTrainer
#7143 opened Sep 9, 2026 by behroozazarkhalili Collaborator Loading…
4 of 5 tasks
1
1
fix: validate dataset mixture fractions before loading
#7142 opened Sep 9, 2026 by behroozazarkhalili Collaborator Loading…
4 of 5 tasks
1
1
fix: score think_format_reward when <think> is prefilled in the prompt
#7141 opened Sep 9, 2026 by behroozazarkhalili Collaborator Loading…
4 of 5 tasks
1
1
Remove the experimental BCO trainer
#7136 opened Sep 9, 2026 by qgallouedec Member Loading…
6
Remove the experimental PRM trainer
#7133 opened Sep 9, 2026 by qgallouedec Member Loading…
2
[AsyncGRPO] Gather FSDP2 weights before NCCL send to vLLM
#7131 opened Sep 9, 2026 by sfc-gh-truwase Loading…
4 of 8 tasks
1
4
fix: validate ngram_size in get_repetition_penalty_reward
#7129 opened Sep 9, 2026 by CJstate Loading…
5 of 6 tasks
1
ProTip! What’s not been updated in a month: updated:<2026-08-14.