Open
Description
起始日期 | Start Date
No response
实现PR | Implementation PR
No response
相关Issues | Reference Issues
No response
摘要 | Summary
The minicpm node have a problem, the models are heavy for some vram gpu, but it not unmount the model from ollama, and cant unmount, and no way I can't unload it from VRAM
If you could add un boton optional for keep alive or else the model will be unmount after generate text.
I have low vram, I have a 4070 12GB VRAM and without this feature it destroy all my workflows, cant use it.
基本示例 | Basic Example
Set MiniCPM Model
Execute (Image and describe by your model)
Unload model of VRAM (with a optional button)
run other things in comfy without over load by model in VRAM
缺陷 | Drawbacks
Nothing.
未解决问题 | Unresolved questions
No response