Intelligence is similarity + compositionality. Transformers' similarity is dot product of embeddings and their compositionality is attention, both still very primitive.
Intelligence: Similarity and Compositionality in Transformer Models
By
–
By
–
Intelligence is similarity + compositionality. Transformers' similarity is dot product of embeddings and their compositionality is attention, both still very primitive.