The Top ML Papers of the Week (July 8 – July 14): – RankRAG
– RouteLLM
– FlashAttention-3
– Internet of Agents
– Learning at Test Time
– Mixture of A Million Experts
…
SYSTEMS
-
Top ML Papers of the Week: RankRAG, RouteLLM, FlashAttention-3
By
–
-
Larger AI Models Better Understanding Intent Performance
By
–
Agreed but it feels like the bigger models should understand the intent and performer better than the smaller ones still
-
Leveraging Unused Distributed Computing Resources Efficiently
By
–
I like it! Tons of unused small compute around us.
-
Distributing AI Inference Across Multiple Smaller Devices
By
–
Sharding inference across multiple smaller devices… 🤔 https://t.co/8b13fdz8h6
— Yohei (@yoheinakajima) 13 juillet 2024Sharding inference across multiple smaller devices…
-
New Computing Paradigm: LLMs as CPUs with Token-Based Architecture
By
–
🚀 OpenAI Co-founder @karpathy recently shared a groundbreaking New Paradigm for the future of computing:
— Dr. Debashis Dutta (@debashis_dutta) 7 juillet 2024
"We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM.
This is… pic.twitter.com/HJt4HJFPlXOpenAI Co-founder @karpathy recently shared a groundbreaking New Paradigm for the future of computing: "We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM. This is
-
Genome Selection and Stock Picking: Managing Uncertainty in Complex Systems
By
–
Picking your genome = picking your stocks. Would be a great strategy if you could predict the consequences of your actions to a high degree of certainty. But you're not that smart, because the world is complex, so you need a strategy that accounts for uncertainty.
-
Simplifying Complexity: Retaining Only What Matters
By
–
Totally agree, it's easy to move complexity around. It's harder to actually simplify yet retain only what's crucial.
-
Brain-Inspired AI Raises Unique Ethical Concerns and Challenges
By
–
A recent study demonstrates that brain-inspired AI raises unique ethical concerns, distinct from traditional AI. It explores conceptual, technical, and societal issues, highlighting the need for a heuristic approach to address these complexities. Brain-inspired AI, while
-
Pure Software 2.0: Neural Network-Only Computer Architecture
By
–
100% Fully Software 2.0 computer. Just a single neural net and no classical software at all. Device inputs (audio video, touch etc) directly feed into a neural net, the outputs of it directly display as audio/video on speaker/screen, that’s it.
-
Replacing Government with AI: Exploring State AI Governance Systems
By
–
What if we replace politicians (and government and bureaus) with an AI system – let's call it State AI – and citizens only vote on values & preferences? This could lead to more consistent, efficient, and non-corrupt governance. What do you think? https://
blog.marekrosa.org/2024/06/state-
ai-government-that-works-for-you.html
…