10/ We can use these probabilities to choose a token, for instance the most probable. Adding the selected token to the prompt + feeding it back to the model allows to generate another token and so on until whole sentences are created as continuations of the input prompt.
GENERATIVE AI
-
LLaMA Team Uses Original MMLU Benchmark Evaluation Code
By
–
3/ It turns out the LLaMA team used the original evaluation code proposed by the authors of the MMLU benchmark (find it at https://
github.com/hendrycks/test) Let's call it the "original implementation" -
Pooling Resources for Cooperative Large Model Training Infrastructure
By
–
Idea: who in the investment community wants to pool resources together to create a cooperative infrastructure for training large models? Feels wasteful to have startups burn VC money to train foundation models to do broadly the same thing.
-
AI Regulation: Benefits for Business and Policymakers
By
–
With the arrival of #GenerativeAI, it’s increasingly critical for governments to promote the responsible use of AI. Global AI Ethicist, @HaniyehMah, shares her insights with @CNBCnow on how AI regulations can benefit both businesses and policymakers. https://
cnb.cx/43076rG -
Databricks acquires MosaicML in 1.3 billion generative AI deal
By
–
Monster outcome @NaveenGRao https://
wsj.com/articles/datab
ricks-strikes-1-3-billion-deal-for-generative-ai-startup-mosaicml-fdcefc06
… -
LLMs Demonstrate Powerful Investigation and Analysis Capabilities
By
–
There is something so powerful about large language models’ abilities here. I could have commissioned an entire team of investigators to attempt to piece something like this together about me, given them months of time and thousands of dollars, and not gotten anything close to
-
AI Reveals Your Identity Through Writing Preferences
By
–
AI is incredible at reflecting back to you who you are. I keep a running list of writing I like and writers I admire in the Notes app on my phone. I threw them into ChatGPT and Claude to pull out patterns, and this is what came out:
-
Gemini: DeepMind Combines Language Models with Reinforcement Learning
By
–
The next @deepmind algorithm, Gemini, may combine a powerful language model with cutting-edge reinforcement learning, perhaps helping with planning and memory. That's one thing I learned from a very interesting chat with @demishassabis recently.
-
Generative AI Technical Evolution: Key Innovations 2012-2022
By
–
Fair enough but Generative AI only really took off since 2020 with much of the technical innovation occurring from 2022 onwards (Chain of Thought 22, LoRA 21 but really adopted 22 and RLHF really took off in a big way 2022). The approaches in 2012 would not get us to LLMs. RNNs
-
How AI Could Reinvent The Communications Industry
By
–
How Artificial Intelligence Could Reinvent The Communications Industry https://
bit.ly/3TTxiSc via @Forbes #AI #FutureofWork