LLMs would *already* have trained on stuff like this for major books, since they would have seen 2 page summaries, 'Cliff's Notes', chapter summaries, etc.
RESEARCH
-
LLMs Recursive Summarization Capabilities and Limitations
By
–
That's an interesting hypothesis! What do you think of this counter-point: AI systems today can get very close to your idea in training, by using an LLM to recursively summarise a long document.
-
AI Scientist automates full research pipeline for under $15 per paper
By
–
The AI Scientist: Agentic, fully-automated research pipeline for under $15 per paper Researchers have just created an AI system that can conduct entire research projects from start to finish, potentially revolutionizing how scientific discoveries are made. This "AI
-
VQ4DiT: Efficient Post-Training Vector Quantization for Diffusion Transformers
By
–
VQ4DiT Efficient Post-Training Vector Quantization for Diffusion Transformers paper page: https://
huggingface.co/papers/2408.17
131
… The Diffusion Transformers Models (DiTs) have transitioned the network architecture from traditional UNets to transformers, demonstrating exceptional capabilities -
Lab advances vision and robotic learning integration
By
–
Our lab’s new work that shows deeper integration of vision and robotic learning! 🤩🦾 https://t.co/MDORPjlkmh
— Fei-Fei Li (@drfeifei) 2 septembre 2024Our lab’s new work that shows deeper integration of vision and robotic learning!
-
Fine-tuning and Merging LLMs: Techniques and Best Practices
By
–
If you're interested in fine-tuning and merging LLMs, here's a well-edited video of a talk I gave in July. We talk about: – How to create a dataset
– SFT techniques
– How to merge models Thanks to @Tunehq_ai for the invitation! https://
youtu.be/8aFqLVQjHTw?si
=K8KpM55G_93wwZmM
… -
Responsible AI Must Keep Pace with ML Capabilities
By
–
@IValeraM pointing out how many open questions there are in causal and ethical machine learning . “We can’t have a technology whose capabilities advance fast without similar speed in advances in responsible ai”. #DLI2024 #Indaba2024 #xamxamle
-
African Youth Education: Balancing Tradition with Global Tech Knowledge
By
–
Amazing closing words from Senegal minister for higher education: “In this new world, if you are a young African, what you have to do is to rely on your tradition, rely on your knowledge,but also take the best in France, Switzerland, USA, Canada and come back in Africa” #DLI2024
-
India AI Initiative Develops Applications for Critical Sectors
By
–
The pillar IndiaAI Application Development Initiative promotes AI applications in critical sectors by addressing problem statements from Central Ministries, State Departments, and other institutions.
— IndiaAI (@OfficialINDIAai) 2 septembre 2024
It focuses on developing, scaling, and promoting the adoption of impactful AI… pic.twitter.com/x8ugDelriwThe pillar IndiaAI Application Development Initiative promotes AI applications in critical sectors by addressing problem statements from Central Ministries, State Departments, and other institutions.
It focuses on developing, scaling, and promoting the adoption of impactful AI -
AI Journey Begins at Princeton University
By
–
I’ve always loved my undergrad alma mater @Princeton . But sharing my book with the freshman class of 2028 and President Eisgruber tonight reminded me how much I LOOOVE Princeton, the place where my search for my intellectual North Star of AI began three decades ago!