Intelligence is similarity + compositionality. Transformers' similarity is dot product of embeddings and their compositionality is attention, both still very primitive.
Intelligence: Similarity and Compositionality in Transformer Models
By
–
Global AI News Aggregator
By
–
Intelligence is similarity + compositionality. Transformers' similarity is dot product of embeddings and their compositionality is attention, both still very primitive.
Leave a Reply