We will add support soon, it's still W.I.P. due to the how hybrid cache support is handled by vLLM V1.
vLLM V1 Hybrid Cache Support Coming Soon
By
–
Global AI News Aggregator
By
–
We will add support soon, it's still W.I.P. due to the how hybrid cache support is handled by vLLM V1.
Leave a Reply