FlashAttention-4 in the official release is huge. The gap between research implementations and production-ready code keeps shrinking. Also nice to see MPS getting more love, Apple Silicon users have been waiting.
FlashAttention-4 Release Bridges Gap Between Research and Production
By
–