is support ollama

[mrLinkD]

Hello. Ty for work. Ican work with my ollama server? Hes locating in local area on other PC.TY

[henrydaum]

I haven't implemented Ollama yet, but I may in the future. If you wanted to try to yourself, you can write a subclass to the BaseLLM class in the Frontend code. It just needs to have invoke(), stream(), and unload() functions like the others. I don't know how Ollama works but it's definitely possible.

[MakksSh]

Hello. Ty for work. Ican work with my ollama server? Hes locating in local area on other PC.TY

https://docs.ollama.com/api/openai-compatibility