We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
- paddlepaddle:2.4.0 - paddlepaddle-gpu: 2.4.0 - paddlenlp: 2.5.2
resize_token_embedding方法仍然存在问题,在bart和pegasus中无效,只更新share,但实际使用的encoder和decoder的embedding层不会更新,最后一层lm_head也不会更新,可能是因为bart和pegasus的encoder和decoder没有set_input_embeddings方法的原因,在t5和gpt中不会更新最后一层lm_head。
复现代码如下 https://aistudio.baidu.com/aistudio/projectdetail/6232319?contributionType=1&sUid=581675&shared=1&ts=1684831403394 版本号:resize_token bug
The text was updated successfully, but these errors were encountered:
请升级一下paddle和paddlenlp的版本试试,现在已经支持了。
PaddleNLP/paddlenlp/transformers/model_utils.py
Line 1320 in 829e7f0
Sorry, something went wrong.
sijunhe
wawltor
No branches or pull requests
软件环境
重复问题
错误描述
稳定复现步骤 & 代码
复现代码如下
https://aistudio.baidu.com/aistudio/projectdetail/6232319?contributionType=1&sUid=581675&shared=1&ts=1684831403394
版本号:resize_token bug
The text was updated successfully, but these errors were encountered: