I would also like to see this comparison. I am curious what is the future: a) larger context windows (potentially infinite)?
b) more advanced retrieval techniques?
c) hybrid of these two?
GENERATIVE AI
-
Future of LLMs: Context Windows vs Advanced Retrieval Techniques
By
–
-
OpenAI’s Secret Sauce Versus Google’s PaLM 2 Performance
By
–
(Though, to be clear, it got very close with its fine-tuned large PaLM 2. So it is also possible that OpenAI has a secret sauce here that Google was not able to match.)
-
OSS Community Settles on 3B and 7B Model Sizes
By
–
So two things are happening here: first is that the OSS community (and potentially Meta) seems to be settling around 3B and 7B. Second is it's surprising Google did not go straight for GPT-4—it seems to me really unlikely that they wouldn't be able to hit that if they wanted.
-
PaLM 2 vs GPT-4 MMLU Performance Comparison Analysis
By
–
PaLM 2 (L) also does not outperform GPT-4 on an MMLU 5-shot, but it does outperform LLaMA-I, a fine-tuned model for LLaMA. Here's what I pulled from the technical reports for LLaMA, PaLM 2, and GPT-4.
-
Small Language Models: 3B and 7B Parameters Emerge in Open Source
By
–
We are seeing a lot of models pop up in the 3B and 7B param range, incl RedPajamas-INCITE 3B from Together that is based on the RedPajamas dataset. That dataset is designed to replicate the LLaMA dataset. I've heard Meta is also exploring 3B as an option for its fully OSS model.
-
Google PaLM 2 Comes in Four Sizes with Mobile Capabilities
By
–
When it comes to PaLM 2, Google said it would come in four sizes. It didn't disclose parameter count, but it did give us some tea leaves to evaluate, the first of which is that Gecko (its smallest) can run on a mobile device offline.
-
LangChain Business Model and Google’s PaLM Announcement Analysis
By
–
Today's issue of Supervised is gonna cover two topics: first, LangChain and questions about its business; second, breaking down some of Google's PaLM announcement. https://
supervised.news/p/parrots-geck
os-and-frameworks-as
… -
Data Whisperer Podcast Episode with Bill Wohl Discussion
By
–
Thanks to @BillWohl61 for hosting and the great conversation, in the latest episode of The #datawhisperer #podcast Enjoy listening https://
jivs.com/podcast/ #supplychain #Procurement #innovation #FutureofWork #AI #ML #ChatGPT #chatbots #chatgpt4 #chatgpt3 #HealthTech -
NPC Demo with Distinct Personality: One Character Designed as a Jerk
By
–
A lot of NPC demos powered by GPT lack personality. Let’s see if you find our demo different in this regard. We made one of the 3 characters a bit of a dick 😛
-
Kunle Olukotun on Pervasive AI Platforms at Generative AI Summit
By
–
Don't miss the panel "Platforms for Pervasive AI", featuring Kunle Olukotun, Chief Technologist and Co-founder at @SambaNovaAI
. Register at https://
aidataanalytics.network/events-generat
iveaisummit/speakers/kunle-olukotun
… for the Generative AI Summit in London, UK.