No, it's a bespoke model. The founder is Noam Shazeer, one of the creators of LaMDA.
LLMS
-
Microsoft Google LLM Deployment Risks and Reliability Concerns
By
–
It's a bit strange to watch Microsoft and Google rush to deploy generative AI while ever more problems with these systems emerge. LLMs have amazing potential but they are born fabricators (see bing query). Would be good to see more focus on making these tools less chaotic.
-
Generative AI Overview: Evolution of Artificial Intelligence
By
–
A Good Overview of the Hottest Area in AI:
What is Generative AI? The Evolution of #AI https://
infoworld.com/article/368997
3/what-is-generative-ai-the-evolution-of-artificial-intelligence.html
… @pierrepinna @sallyeaves @Xbond49 @PawlowskiMario @mikeflache @psb_dc @SpirosMargaris @HaroldSinnott @Shi4Tech @TheRudinGroup #MachineLearning #DeepLearning #Fintech -
Flan-T5-XXL Performance Compared to Decoder-Only Models
By
–
people also forget that the speed of flan-t5-xxl is also equivalent to a ~5B+ decoder-only model because it's an encoder-decoder model.
-
ChatGPT and GDPR: AI Chatbots Impact on Data Privacy
By
–
ChatGPT vs #GDPR – what #AI #Chatbots mean for #Data #Privacy
by Camilla Winlo @InformationAge Read more: https://
buff.ly/3HWTHZ3 #BigData #MachineLearning #ArtificialIntelligence #ML #MI cc: @terenceleungsf @ronald_vanloon @yvesmulkers -
ChatGPT Limitations: Understanding AI Language Model Challenges
By
–
#ChatGPT is a highly advanced #AI language model — but it has a number of #limitations. Read on to find out more about ChatGPT’s limits, and how you should take these #challenges into #consideration when you’re using this groundbreaking tool.
-
NAS Results Reduce Language Model Training Emissions by 1.3X
By
–
It's actually more ironic. The results of one-time NAS (which took 88X less CO2 than the external paper estimated) are open-sourced and make training language models 1.3X faster & produce 1.3X less emissions (see figure 4 in https://
arxiv.org/abs/2104.10350) https://
github.com/tensorflow/ten
sor2tensor/blob/master/tensor2tensor/models/evolved_transformer.py
… -
Rumored GPT-4 launch at Microsoft AI event on March 16
By
–
Rumored to be GPT-4 launch event: Microsoft special event “Reinventing productivity with AI” hosted by CEO @satyanadella on March 16th at 8:00am PST
-
Keywords Still Improve AI Sentence Understanding Better
By
–
agree and disagree, i think they are getting closer to understanding sentences well but currently you still get much much better results adding keywords to your prompts
-
Dropout Layers Leak Training Phase Information in Transformers
By
–
Dropout layers in a Transformer leak the phase bit (train/eval) – small example. So an LLM may be able to determine if it is being trained and if backward pass follows. Clear intuitively but good to see, and interesting to think through repercussions of