realized yesterday that if a closed-source AI company had invented flash attention nobody would know about it – and this makes me sad for the current state of AI knowledge sharing many cool AI algorithmic improvements are probably already being kept behind closed doors

→ View original post on X — @thom_wolf,