vLLM Spyre Plugin

See vLLM official support: https://github.com/vllm-project/vllm-ascend

vLLM with support for span semantics

Framework to reduce autotune overhead to zero for well known deployments.

Deep Learning Project HS21