This is worth noting: it appears to be the first evidence that LLMs can improve performance at a task through self-play. In this case, Llama-2 7B was able to greatly improve its ability to play the game of Adversarial Taboo by training through adversarial competition with itself
RESEARCH
-
Meta does what OpenAI should be doing – Discussion
By
–
Meta does everything OpenAI should be Discussion on r/MachineLearning https://redd.it/1cbhec7
-
LLMs Intelligence: Argument Evaluation and Personalized Appeal Prediction
By
–
LLMs are already pretty intelligent; they can distinguish between strong and weak arguments, predict stances based on beliefs and demographic characteristics, and determine the appeal of an argument to an individual based on their traits. The paper below shows that LLMs perform
-
Data Is Everything in AI Development
By
–
Yes, 100%. I’ve been saying this for a long time… the data is everything.
-
Dataset Quality: The Foundation of AI Model Performance
By
–
The dataset is everything. Great read: https://
nonint.com/2023/06/10/the
-it-in-ai-models-is-the-dataset/
… -
Snowflake Arctic Cookbook Blog Series Launched
By
–
Looks like the Snowflake Arctic cookbook blog series is only just getting started, but will show up here https://
snowflake.com/en/data-cloud/
arctic/cookbook/
… (I absolutely hate how Twitter actively disincentivizes linking to things these days) -
Solving Long-Context LLaMA 3 by End of Day
By
–
By the end of today, I think we will have solved long-context LLaMA 3.
-
Fast Generation in Large Models with Sparse Parameter Activation
By
–
Not sure how it will play out, but it means that generations will be very fast for such a big model, as only a small portion of params will be active at a time.
-
Snowflake Releases Largest Open-Source Model 482B Parameters
By
–
Snowflake just launched the largest open-source model yet. A 482B parameter MoE. 17B active parameters and 128 experts, trained on 3.5T tokens. This model is more open than others — even the data recipe is open-source!