Pretty well! TPUs are quite good for serving models like these, and we have awesome folks doing a great job of performance tuning to squeeze even more juice from them.
TPUs Excel at Model Serving with Advanced Performance Tuning
By
–
By
–
Pretty well! TPUs are quite good for serving models like these, and we have awesome folks doing a great job of performance tuning to squeeze even more juice from them.