Support RKLLM

[sfxworks]

I'd like the option to use the AI accelerators exposed on Rockchip devices, such as the Quartz64

https://github.com/airockchip/rknn-llm

[docjyJ]

RKLLM support allows closing #2205

[sfxworks]

Was told I can expose the npu on the quartz64 via this patch https://lore.kernel.org/lkml/20240612-6-10-rocket-v1-0-060e48eea250@tomeuvizoso.net/T/#u

ill try to test it, and elaborate on it. I've never built a grpc endpoint, but I imagine that's an aspect of this.

https://blog.tomeuvizoso.net/2024/03/rockchip-npu-update-1-walk-in-park.html
https://blog.tomeuvizoso.net/2024/06/rockchip-npu-update-4-kernel-driver-for.html

[alexeyvolkoff]

Hi @sfxworks, what is progress with the patch for rk3588 chips?