8/ DocLLM – an extension to traditional LLMs for reasoning over visual documents; focuses on using bounding box information to incorporate spatial layout structure; demonstrates SoTA on 14 of 16 datasets across several document intelligence tasks.
AI
-

LLM Augmented LLMs: Composing Models for Expanded Capabilities
By
–
5/ LLM Augmented LLMs – explore composing existing foundation models with specific models to expand capabilities; introduce cross-attention between models to compose representations that enable new capabilities.
-

Fast Inference of Mixture-of-Experts Models via Offloading
By
–
6/ Fast Inference of Mixture-of-Experts – achieves efficient inference of Mixtral-8x7B models through offloading; designs a MoE-specific offloading strategy that enables running Mixtral-8x7B on desktop hardware and free-tier Google Colab instances.
-

LLaMA Pro: Post-Pretraining Method Without Catastrophic Forgetting
By
–
4/ LLaMA Pro – proposes a post-pretraining method to improve an LLM’s knowledge without catastrophic forgetting; it achieves this by tuning expanded identity blocks using only new corpus while freezing the inherited blocks.
-
Mobile ALOHA: Bimanual Mobile Manipulation via Low-Cost Teleoperation
By
–
1/ Mobile ALOHA – proposes a system that learns bimanual mobile manipulation with low-cost whole-body teleoperation; it first collects high-quality demonstrations and then performs supervised behavior cloning.https://t.co/Vf4REkMBuW
— DAIR.AI (@dair_ai) 7 janvier 20241/ Mobile ALOHA – proposes a system that learns bimanual mobile manipulation with low-cost whole-body teleoperation; it first collects high-quality demonstrations and then performs supervised behavior cloning.
-

32 Techniques to Mitigate Hallucination in Large Language Models
By
–
2/ Mitigating Hallucination in LLMs – summarizes 32 techniques to mitigate hallucination in LLMs; introduces a taxonomy categorizing methods like RAG, Knowledge Retrieval, CoVe, and more.
-
Top ML Papers of the Week: DocLLM, ALOHA, Fine-tuning
By
–
The Top ML Papers of the Week (Jan 1 – Jan 7): – DocLLM
– Mobile ALOHA
– Self-Play Fine-tuning
– Fast Inference of MoE
– LLM Augmented LLMs
– Mitigating Hallucination in LLMs
… -
Legal dispute acknowledges AI infringement basis implicitly
By
–
Re “main use case”, i can imagine a reply like this: “You just said a lot of time it doesn’t infringe. I agree. But you have thereby also just implicitly acknowledged that sometimes it does infringe. Now that you have acknowledged the fundamental premise of my suit is true,
-
Ethical concerns about influential AI figures and power dynamics
By
–
you don’t think calling me a grifter etc was lower? did you read his tweet that prompted me to block him? Or the arguments i made her in this thread for why I do in fact find him to be dangerous, given his lack of ethics combined with his power?
-
IP Law Implications for AI: Copyright and Trademark Concerns
By
–
Basically, I am seeing two kinds of responses to Marcus & @Rahll @ieespectrum here: People who understand the basics of copyright and trademark law and realize the implications. People who have no idea how IP law actually works but just enjoy making comments. You could