The vast majority of them use deep learning, i.e. ConvNets trained with backprop. It's not LLMs but it is AI.
@ylecun
-
Deep Learning Without LLMs: Neural Net Backpropagation Focus
By
–
It's all based on neural net / deep learning trained with backprop.
But none of it uses LLMs, GPT, or other token-based generative architectures. -
MRI Technology Advancement Reduces Time and Cost
By
–
I wasn't advocating the indiscriminate use of full-body MRIs, but the fact that the technology that makes this possible reduces the time and cost of an MRI exam is intrinsically a Good Thing.
-
LLMs vs Vision Systems: Neural Nets and Architecture Differences
By
–
Absolutely nothing. They both use neural nets and backprop. But LLMs are generative architectures trained on sequences of discrete symbols. Vision systems used in AEBS and other applications use ConvNets or ViTs trained to detect and classify from labelled samples.
-
Killer Drones Defending European Democracy Against Invasion
By
–
Right now, "killer drones" are protecting European democracies against an invader.
-
LLMs Dominated by Industry Limits Academic Research Contribution
By
–
I didn't say that. I said that LLM is in the hands of industry, is largely engineering, and requires too much computing resources for academics to contribute significantly. More importantly, LLMs are today's technology. Academic researchers, particularly PhD students, should be
-
Joint Embedding Architectures: Vision Encoders Beyond LLMs
By
–
Through 1. Vision encoders that are not LLMs. They are actually Joint Embedding Architectures that embed images and text description in the same space
2. Painfully exhaustive training on enormous amounts of declarative facts about the physical world. You can train them to answer -
Why LLMs fail at physical world understanding compared to JEPA
By
–
We still don't have AI systems that understand the physical world as well as a cat. JEPA are getting there. LLMs and other generative architectures are not. Generative architectures, particularly those that produce discrete tokens like LLMs simply ***DO NOT WORK*** for
-
Exponential Growth is Actually Sigmoid Curves in Disguise
By
–
People criticize me because they fail to see that every real-world process that looks like an exponential is really the initial segment of a sigmoid. Even processes that remain exponential for a while are actually a succession of small sigmoids, each corresponding to a major