Cambrian explosion happening lately running LLMs on cheap commodity hardware. For perspective, this is 4x bigger than GPT-2 and only 1 OOM smaller than GPT-3. There's a huge number of security and privacy-conscious applications becoming "good enough" to do self-hosted.
LLMs on Commodity Hardware: Cambrian Explosion of Self-Hosted AI
By
–
