The results are very impressive. You can quickly see why it's the best performing open source LLM. "Write a poem about open source machine learning in the style of Byron."
INNOVATION
-
Automation History: Humans Innovate New Production Forms
By
–
the means of production has already been 98% automated multiple times in human history. humans just start producing new things that their ancestors wouldn’t recognize as production
-
LLMs Learning to Recognize Knowledge Gaps and Delegate Tasks
By
–
Soon, LLMs will know when they don’t know. They’ll know when to say IDK, or instead ask another ai, or ask a human, or use a different tool, or different knowledge base. This will be a hugely transformative moment.
-
Zero-Sum Performance Trade-offs in Attention Mechanisms
By
–
Yeah but my guess is it’s a zero sum issue. Like if you fixing the performance in the middle, you will probably have to sacrifice performance elsewhere. Otherwise if you pay attention to everything equally, you’ll lose the advantage of attention in a way.
-
Appreciation for Different Content Direction from Standard LLM Topics
By
–
Glad to hear that you liked this slight departure from the usual LLM content!
-

First AI-Powered Toothbrush Purchase Consumer Technology
By
–
Just bought my first AI powered toothbrush
-
AI Progress: From Skepticism to Practical Implementation Reality
By
–
Amazing how the ai debate has gone from ‘it doesn’t work, it’s a pipe dream’ a decade ago, to ‘great but it’s not 100% accurate all the time so don’t use it for high stakes tasks’… Just give it a couple more years
-

Generative AI and The Future of Creative Jobs
By
–
Generative #AI and The Future of Creative #Jobs https://
bit.ly/3nrSK4u #FutureofWork -
Hyena Convolutional LLMs: Efficient Alternative to Transformers
By
–
Hyena convolutional LLMs look interesting. Not necessarily better but matches the performance more or less. It’s different but more efficient. We will see if this will get more interest vs continuing the transformer route.
