nice trend over the last year is that folks in AI have finally produced a few libraries with the right abstractions finally our code can be both hackable and fast, not just one or the other. this never used to happen vLLM, sglang, verl..
this is the dawn of Good Software in AI

→ View original post on X — @jxmnop