Skip to content

为啥现做RLHF 不支持sequence_parallel #4089

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
dhhcj opened this issue May 6, 2025 · 0 comments
Open

为啥现做RLHF 不支持sequence_parallel #4089

dhhcj opened this issue May 6, 2025 · 0 comments

Comments

@dhhcj
Copy link

dhhcj commented May 6, 2025

Describe the feature
Please describe the feature requested here(请在这里描述需求)

Paste any useful information
Paste any useful information, including papers, github links, etc.(请在这里描述其他有用的信息,比如相关的论文地址,github链接等)

Additional context
Add any other context or information here(其他信息可以写在这里)
RT, 目前3.31,3.4.0 都不支持,但是以前的版本都支持,我也是最近升级的时候发现的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant