Think a more likely one would be to help people create the best, most optimised AWQs and then they can deploy wherever they want ofc you can have direct deployment options. But I’m 100% there’s value in this.
Optimizing AWQ Deployment for Flexible Model Distribution
By
–
Leave a Reply