You might do better if you think of them as just retrieving vectors on words and adding up the vectors, rather than doing LLM-style processing.
Thinking of Language Models as Vector Retrieval Systems
By
–
By
–
You might do better if you think of them as just retrieving vectors on words and adding up the vectors, rather than doing LLM-style processing.