More info on LLaMA here: https://research.facebook.com/publications/llama-open-and-efficient-foundation-language-models/ …
RESEARCH
-
Meta’s new LLaMA model paper highlights PaLM’s capabilities
By
–
Meta's new AI model LLaMA came out today. The paper was a gentle reminder of how capable Google's 540-billion parameter model PaLM will be.
-
LLaMA omits GPT’s results from MMLU test chart due to size.
By
–
This was the Massive Multitask Language Understanding test (Humanities, STEM, Social Sciences, etc) When finetuned for the test, LLaMA omitted GPT's superior results from the chart because it is not of "moderate size"
-
RLHF Adoption Accelerates Across Industries for Aligned AI
By
–
Today, a senior military official asked me about reinforcement learning with human feedback (RLHF). This is awesome—the widespread adoption of RLHF across every industry and use case is critical for the safe, aligned, and useful deployment of AI and LLMs. RLHF is taking over!
-
Why Innovation is Stalling: Michael Gibson’s Perspective
By
–
Why is innovation stalling? Michael Gibson, a fascinating author, investor and leader, has ideas https://
youtube.com/shorts/sjD_Hp6
Jfas?feature=share
… -
10B Parameter Models Vastly Underestimated in Capacity
By
–
It's increasingly clear we've severely underestimated how much you can pack in a 10B parameters model
-
Defining AGI: OpenAI’s Essential Framework and Objectives
By
–
Ahora, la parte más importante… A QUÉ COÑO LLAMAMOS AGI …es el problema de siempre y algo que nunca me ha gustado de esta idea. Por suerte el otro día en un post diferente de OpenAI me encontré esta definición. Ahí está, ese es el objetivo 🙂
-
OpenAI’s Shift Away From Open Source Mission Criticized
By
–
Texto a pie de página con algún dato interesante respecto al cambio de rumbo que tanto se le ha criticado a OpenAI, donde dejaron atrás parte de su identidad inicial de "open" y sin ánimo de lucro.
-
OpenAI Reveals Explicit Plans for AGI Development and Beyond
By
–
Este nuevo post en el blog de OpenAI habla explícitamente de los planes de la compañía para la llegada de la AGI. Lo leo por un lado con el exceptisimo que he tenido al tema a lo largo de los últimos años, y con la sorpresa de ver que podría ser posible. https://
openai.com/blog/planning-
for-agi-and-beyond/
… -
Deep Learning Models vs Systems: Bridging the Complexity Gap
By
–
Building a Deep Learning model is only a fraction of the work. Building an entire Deep Learning System is much more complex and takes time. Closing this gap is precisely what @abacusai does.