2. Emergence is a phenomenon where large language models gain abilities that are not present in smaller language models. An example of an emergent ability is doing complex math questions.
INNOVATION
-
Scaling Laws: Model Size, Data, and Compute for LM Improvement
By
–
Key takeaways: 1. Scaling involves increasing model size, data, and compute. Scaling is challenging (cost, infra, etc), but important, since "scaling laws" tell us that scaling predictably makes LMs better.
-
Three Ideas Driving the LLM Revolution: Scaling, Emergence, and Reasoning
By
–
I gave an invited lecture at New York University for @hhexiy
's class! I covered three ideas driving the LLM revolution: scaling, emergence, and reasoning. I tried to frame them in a way that reveals why large LMs are special in the history of AI. Slides: -
5G Network Modernization: Catalyst for Digital Infrastructure
By
–
5G is the catalyst for network modernization.
-
Automation becomes essential as data volume grows exponentially
By
–
The sheer volume of data makes automation imperative.
-
Efficient LLM Training with Sparsity and Dataflow Techniques
By
–
TECHNICAL RESEARCH PAPER: Training Large Language Models Efficiently with Sparsity and Dataflow This paper demonstrates an end-to-end training flow on a LLM – 13 billion GPT – using sparsity and dataflow. @arxiv
: https://
arxiv.org/abs/2304.05511
PDF: https://
arxiv.org/pdf/2304.05511
.pdf
… #ml #llm -
Sam Altman GPT-4 MIT Sandberg Center Record Attendance
By
–
There’s never been as many people in MITs Sandberg center as there are for Sam Altman speaking about GPT-4 and generative AI. You can feel the east coast fomo
-
NVIDIA RTX Gaming Trends Ray Tracing DLSS Adoption Shift
By
–
Uncover the shift in gaming trends as @NVIDIAGeForce RTX users fully enable ray tracing and DLSS. #RTXOn
-
MIT’s First Major Generative AI Conference Features Wolfram and Altman
By
–
MIT’s first big generative AI conference is packed for Lex Friedman interviewing Stephen Wolfram (or perhaps because
@sama
is up next…) -
Distinguishing GPT-4 from GPT-3: Reasoning and LLM Integration
By
–
difficile de savoir si c'est gpt4 ou gpt3 sur ce genre de question. par contre sur des "raisonnements", on voit plus facilement la différence. Mais bientôt lorsque ce sera connecté aux autres LLM, ca va être très très compliqué, et c'est déjà là…