Through experimentation @LinkedIn found EON-8B, a domain-adapted version of Llama 3.1 8B, to be 75x and 6x cost effective in comparison to GPT-4 and GPT-4o respectively. More on their domain-adapted foundation model work https://
go.fb.me/curuy3
RESEARCH
-

LinkedIn’s EON-8B Model: 75x More Cost-Effective Than GPT-4
By
–
-
Manual Feature Extraction and Count Vector Representations in ML
By
–
Oh I see what you mean. Here human experts don’t necessarily extract the features. What I meant was more like humans came up with the idea that count vectors are a good representation (vs inputting the raw sentence). Ie here with manual feature extraction I mean the
-
DeepSeek Introduces Flash Thinking Model for Advanced AI Reasoning
By
–
“Flash Thinking (our first ‘thinking’ model, expect a lot more news on this soon – as many of you remember, we pioneered this type of model with AlphaGo, AlphaZero, AlphaProof…)”
-
Google Releases Imagen 3, Veo 2, Genie 2 and Gemini 2.0 Flash
By
–
It’s been an amazing last couple of weeks, hope you enjoyed our end of year extravaganza as much as we did! Just some of the things we shipped: state-of-the-art image, video, and interactive world models (Imagen 3, Veo 2 & Genie 2); Gemini 2.0 Flash (a highly performant and
-

Ownership Rights of AI Models and Training Data
By
–
Repeat after me: NOT YOUR WEIGHTS, NOT YOUR BRAIN! https://t.co/NAKaZTavci
— Vaibhav (VB) Srivastav (@reach_vb) 23 décembre 2024Repeat after me: NOT YOUR WEIGHTS, NOT YOUR BRAIN!
-
Internet Access More Effective Than Hallucination Research for Models
By
–
Realization: the old style of “hallucinations research” via self-calibration is probably going to die down. I used to be very excited about it but now I am skeptical because giving models internet access (e.g., searchGPT, perplexity) is turning out to be way higher ROI. When
-
Scalability Requires Simplicity, Efficiency, and Strong Generalization
By
–
So you should certainly work on scalable AI ideas (which generally implies *simple* ideas). But you should also pay close attention to efficiency & generalization characteristics of your ideas. Data & compute on their own aren't going to save your bad ideas from eventual failure.
-
Naive Bayes Spam Filtering Feature Extraction Discussion
By
–
This is actually a fun discussion! Regarding naive Bayes for spam filtering, in my view, that's definitely manual feature extraction as you have to construct term frequency vectors as input to the model (i.e., bag of words). Alternatively, you could use embeddings like from
