when people were working on BERT i always found these types of visualizations compelling. seeing the attention mechanism in action is so cool why are they not popular anymore? do our models have too many layers for us to understand now? or are attention maps just not useful?

→ View original post on X — @jxmnop