And yet still no mention on Wikipedia or nearly any article or book about the history of LLMs or AI.
LLMS
-
ULMFiT Language Modeling Self-Supervised Pre-training Innovation
By
–
For sure. And indeed CV pre-training was a key inspiration for ULMFiT. AFAIK there wasn't previous examples of using language modeling on a general purpose corpus as a self-supervised task then fine-tuning that in two more steps for downstream tasks (i.e like today's LLMs).
-

MIT Reveals Simpler Method for Adapting Large AI Models
By
–
What if adapting large AI models for specific tasks was far simpler than we thought? Yulu Gan and Phillip Isola at MIT CSAIL reveal a surprising truth. They found that big pretrained models are already 'dense' with specialized experts. Their RandOpt method skips complex
-
Should ChatGPT Develop an Evergreen Variant
By
–
should we have chatgpt develop an evergreen variant
-

LLM trained on Victorian-era British texts dataset
By
–

Want to talk to the past? Here is an LLM "trained entirely from scratch on a corpus of over 28,000 Victorian-era British texts published between 1837 and 1899, drawn from a dataset made available by the British Library." Quite different from an LLM roleplaying a Victorian.
-

Neuron-freezing technique stops LLMs from unsafe responses
By
–
Neuron-freezing' technique can stop #LLMs from giving users unsafe responses
by Matt Shipman @TechXplore_com Learn more: https://
bit.ly/3NKV5F8 #GenerativeAI #ArtificialIntelligence #MachineLearning -
MoonDream 3 API Integration Challenges and Usage Options
By
–
MoonDream 3 is impressive, but the API surface is pretty messy right now. There are three ways to use MoonDream 3 right now. Option 1 (Hugging Face Transformers – model download only) You need a Hugging Face token to download the model. It is gated. With some tweaks, this
-

OpenAI Employee Claims 80% of Code Now Written by AI
By
–
Nice list I think it’s about time-especially with all the expected openweights-to update my list of recommendations
-
High expectations for Claude model despite recent setbacks
By
–
We’re all doing our best Hopefully I’ll make local inference the easy by-default within the next 3 years (also why I am raising haha)
-
AI Researchers Debate LLM Capabilities: Correlation vs. Causation
By
–
if you’re using Ollama switch to llama.cpp if you’re using OpenClaw switch to Hermes these are basics at this point