I didn't say that. I said that LLM is in the hands of industry, is largely engineering, and requires too much computing resources for academics to contribute significantly. More importantly, LLMs are today's technology. Academic researchers, particularly PhD students, should be
RESEARCH
-
Joint Embedding Architectures: Vision Encoders Beyond LLMs
By
–
Through 1. Vision encoders that are not LLMs. They are actually Joint Embedding Architectures that embed images and text description in the same space
2. Painfully exhaustive training on enormous amounts of declarative facts about the physical world. You can train them to answer -
Why LLMs fail at physical world understanding compared to JEPA
By
–
We still don't have AI systems that understand the physical world as well as a cat. JEPA are getting there. LLMs and other generative architectures are not. Generative architectures, particularly those that produce discrete tokens like LLMs simply ***DO NOT WORK*** for
-
Exponential Growth is Actually Sigmoid Curves in Disguise
By
–
People criticize me because they fail to see that every real-world process that looks like an exponential is really the initial segment of a sigmoid. Even processes that remain exponential for a while are actually a succession of small sigmoids, each corresponding to a major
-
Decoupled DiLoCo Paper Now Available on Arxiv
By
–
The Arxiv for the new Decoupled DiLoCo paper is now up:
-
Joint Embedding Architectures Outperform Generative Models for Sensor Data
By
–
What proves that the generative approach is wrong is oodles of empirical results showing the superiority of joint embedding architectures over generative ones (based on reconstruction) for natural sensor data (e.g. images and video). It's not just for self-supervised learning
-
Weekly Optimist Roundup: mRNA Cancer Vaccine to Robot Bio Labs
By
–
Pancreatic cancer mRNA vaccine shows lasting results
SpaceX buys Cursor option
Fervo files S-1
Humble unstealths cabless truck
Madra launches robot arm bio lab + Science Breakthroughs + Extra Doses What a week for the optimists. -
Robot with superhuman reflexes masters ping pong
By
–
Ping pong playing robot has super-human reflexes! https://
youtu.be/SBtYUZJnquM?si
=TLIkxwERHZUDYS-H
… via @YouTube #tablettennis #pingpong #humanoidtech #humanoid #robot #Robotics #AI #TechRevolution #TechInnovation #ArtificialInteligence #PhysicalAI @PawlowskiMario @chidambara09 @Ym78200 -
Economist analyzes AI’s economic impact including post-AGI scenarios
By
–
One of the smartest economists (and best people) I know is looking forensically into what AI’s economic impact — including post-AGI economics — will actually be. Desperately needed work, as there is so much fear and “vibes” on AI’s economic impact. Follow along
-
The Law of Unintended Consequences in AI and Technology
By
–
The law of unintended consequences is undefeated.