Not sure if we have the spare GPUs atm, doesn’t look as likely in the short term tho – since it might need some updates in TGI. Folks from @hyperbolic_labs mentioned (on shared slack) they might deploy it!
GPU Deployment Challenges for AI Model Infrastructure
By
–