Controversial take: you don't need any of this. LLMs have gone through a lot of training already, so there ought to be a better method to turn them into extremely good embedding models. This is what my group has been working on. LLM2Vec is one such idea. We have some exciting developments recently where LLMs themselves can generate superior embeddings with zero changes to the LLM. Stay tuned! dr. jack morris (@jxmnop) x.com/i/article/203102900413… — https://nitter.net/jxmnop/status/2031051636068782402#m

→ View original post on X — @hugo_larochelle, 2026-03-10 03:59 UTC