LLMs rely heavily on transformers, which make use of an "attention mechanism" for modeling interactions among inputs. But this attention mechanism is inefficient and thus difficult to scale to longer contexts. Because of this, researchers have been experimenting w/"linear
@mit_csail
-
MIT Professors Explore Generative AI Potential Language Code Images
By
–
MIT professors on the expansive potential of generative AI, including language, code, & images: https://t.co/Pq0HG2B0Uc pic.twitter.com/5DDiMl9MFB
— MIT CSAIL (@MIT_CSAIL) 21 novembre 2024MIT professors on the expansive potential of generative AI, including language, code, & images: https://
bit.ly/3Z1eqmV -
AI monitoring species changes globally using acoustics and remote sensing
By
–
MIT assistant professor Sara Beery on how her research group applies AI to monitor how species are changing around the world, including using tools like acoustics, sonar, & remote sensing data.
— MIT CSAIL (@MIT_CSAIL) 19 novembre 2024
Full video: https://t.co/AIjVJlwQ6b pic.twitter.com/90OkbWaG4yMIT assistant professor Sara Beery on how her research group applies AI to monitor how species are changing around the world, including using tools like acoustics, sonar, & remote sensing data. Full video: https://
bit.ly/3ANNqiR -
MIT Boltz-1 Predicts Protein RNA DNA Structures Open Source
By
–
MIT researchers recently developed "Boltz-1," which can predict the 3D structure of proteins, RNA, DNA, & small molecules at an accuracy comparable to AlphaFold 3.
— MIT CSAIL (@MIT_CSAIL) 18 novembre 2024
A thread on the first commercially available, open-source model to achieve this feat ⬇️ https://t.co/t7VcyunXsYMIT researchers recently developed "Boltz-1," which can predict the 3D structure of proteins, RNA, DNA, & small molecules at an accuracy comparable to AlphaFold 3. A thread on the first commercially available, open-source model to achieve this feat
-
Inside LLM Architecture: Layers and Matrix Operations Explained
By
–
Take a peek inside an LLM, including all its layers & matrix operations: https://
tinyurl.com/mtvxu2nm v/
@santiviquez & @BrendanBycroft -
iPhone Generates Over $1 Billion Revenue Every Two Days
By
–
17 years later, the iPhone makes over $1 billion in revenue every two days. v/
@JonErlichman -
Intel’s First Single-Chip CPU: A Computing Milestone
By
–
#otd in 1971 Intel unveiled the first single-chip CPU. 4 bits, 16 pins & 740KHz: https://
bit.ly/3YLCqdV -
LucidSim Advances Autonomous Intelligent Machines Through Safe Simulation Learning
By
–
LucidSim is paving the way toward a new generation of intelligent machines that elevate & amplify human effort. The researchers envision these machines could safely and autonomously learn how to navigate our complex world w/o ever setting foot in it. The team’s immediate plan is
-
LucidSim: Advancing Agent Learning Through Simulation
By
–
Authors: Alan Yu (
@alany1_
), Ge Yang (
@EpisodeYang
), Ran Choi, Yajvan Ravan, John Leonard (
@jleonardmit
), & Phillip Isola (
@phillip_isola
)
Paper: https://
bit.ly/3CshpNI Full video: https://
bit.ly/3UQxRxF Website: https://
lucidsim.github.io