Skip to content

[Question]: UIE蒸馏模型的部署 #6276

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
cqray1990 opened this issue Jun 29, 2023 · 1 comment
Closed

[Question]: UIE蒸馏模型的部署 #6276

cqray1990 opened this issue Jun 29, 2023 · 1 comment
Assignees
Labels
question Further information is requested triage

Comments

@cqray1990
Copy link

cqray1990 commented Jun 29, 2023

请提出你的问题

蒸馏UIE-mini 模型底座ernie-3.0-mini-zh
:UIE蒸馏模型的部署可以直接用UIE deploy 的infer.py,? Taskflow 加了uie-data-distill-gp,只能用以下方式推理?
ie = Taskflow("information_extraction",model="uie-data-distill-gp", task_path="data_distill/checkpoint-mini/model_best")

我尝试用infer.py代码替换模型预测,报错
start_prob, end_prob = self._infer(input_dict)
ValueError: not enough values to unpack (expected 2, got 1)
@AlphaHinex @ZeyuChen

@cqray1990 cqray1990 added the question Further information is requested label Jun 29, 2023
@w5688414
Copy link
Contributor

w5688414 commented May 8, 2024

根据提示,只有一个输出,您应该这样写:

out = self._infer(input_dict)

@paddle-bot paddle-bot bot closed this as completed May 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested triage
Projects
None yet
Development

No branches or pull requests

3 participants