Skip to content

[Question]: fast-tokenizer 不支持python3.11？ #6530

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
526872163 opened this issue Jul 27, 2023 · 1 comment
Closed

[Question]: fast-tokenizer 不支持python3.11？ #6530

526872163 opened this issue Jul 27, 2023 · 1 comment
Assignees
@joey12300 @wawltor
Labels
question Further information is requested triage

Comments

@526872163
Copy link

请提出你的问题

我使用paddlenlp需要使用python3.11加速项目，但是安装的时候找不到支持python3.11 的fast-tokenizer pip安装包，请尽快提供，此外是否可以使用手动编译源码的方式支持python3.11
@526872163 526872163 added the question Further information is requested label Jul 27, 2023
@w5688414
Copy link
Contributor

w5688414 commented May 7, 2024

目前由于人力问题，已经停止更新fast-tokenizer了，欢迎开发者贡献。

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/fast_tokenizer

@paddle-bot paddle-bot bot closed this as completed May 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@joey12300 joey12300

@wawltor wawltor

Labels
question Further information is requested triage
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@joey12300 @w5688414 @wawltor @526872163