We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
想部署更大的模型,单卡的显存只有16G,不足矣部署。 codegen推理支持单个模型单机多卡吗?如果支持,该这么做呢?
The text was updated successfully, but these errors were encountered:
暂不支持哦。
Sorry, something went wrong.
wawltor
No branches or pull requests
请提出你的问题
想部署更大的模型,单卡的显存只有16G,不足矣部署。
codegen推理支持单个模型单机多卡吗?如果支持,该这么做呢?
The text was updated successfully, but these errors were encountered: