Wow, what an awesome start into the new week! Hope PyTorch adopts it in their next version release (like they integrated FlashAttention).

→ View original post on X — @rasbt