This particular view is a decade out of date. You know that next-token prediction is mostly self-supervised, and as such the problem-solution pairs are "automatically" generated? Doing the same to train "I don't know next token" is a minor reframe, much research exists.
RESEARCH
-
Northern Lights Deep Learning Conference Proceedings Volume 265 Published
By
–
Volume 265 Proceedings of the 6th Northern Lights Deep Learning Conference https://
proceedings.mlr.press/v265/ Is now available on PMLR -
Modern GAN Baseline: The GAN is Dead, Long Live the GAN
By
–
The GAN is dead; long live the GAN! A Modern GAN Baseline https://
arxiv.org/abs/2501.05441 https://
github.com/brownvc/R3GAN HuggingFace: -
Train Your Own O1 Preview Model for Under $450
By
–
Sky-T1: Train your own O1 preview model within $450 https://
novasky-ai.github.io/posts/sky-t1/ -
FedCFA: Counterfactual Federated Learning Resolves Simpson’s Paradox
By
–
FedCFA: Alleviating Simpson’s Paradox in Model Aggregation with Counterfactual Federated Learning https://
arxiv.org/abs/2412.18904 -
Critical Education Trends Defining Learning In 2025
By
–
7 Critical Education Trends That Will Define Learning In 2025 The #education landscape in 2025 is undergoing a dramatic #transformation, with #AI-powered personalized #learning, human-centric #skills, and lifelong learning becoming central to modern #education. From virtual
-
Tesla and NVIDIA: Divergent Paths in AI Training Data Strategy
By
–
Why Tesla And NVIDIA Are Taking Different Paths To Train AI Systems The debate between #synthetic and #realworld #data is reshaping how companies approach #AI development, with industry giants like #NVIDIA and #Tesla taking opposing #strategies. Here, we explore the pros and
-

Top AI Governance Papers from 2024 Collection
By
–
Top #AI Governance Papers from 2024! Links to the papers are available here: https://
linkedin.com/posts/petersla
ttery1_oliver-patels-list-of-top-ai-governance-activity-7284207525753700352-Ophz?utm_source=share&utm_medium=member_ios
… -

Disposable Environments for Ad-Hoc AI and ML Analyses
By
–
Disposable environments for ad-hoc analyses https://
bit.ly/3DrqvLe
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
New January 2025 Release of Speech and Language Processing
By
–
Happy New Year everyone! Jim and I just put up our January 2025 release of Speech and Language Processing! Check it out here: web.stanford.edu/~jurafsky/s…