Qihoo-T2X An Efficiency-Focused Diffusion Transformer via Proxy Tokens for Text-to-Any-Task discuss: https://
huggingface.co/papers/2409.04
005
… The global self-attention mechanism in diffusion transformers involves redundant computation due to the sparse and redundant nature of visual

→ View original post on X — @_akhaliq