"The purpose of abstraction is not to be vague, but to create a new semantic level in which one can be absolutely precise." — Edsger Dijkstra
RESEARCH
-
GPT-3 training: SFT vs RLHF and EOT penalty issue
By
–
It "isn't pretty" but still works with effort. GPT-3 was just SFT for a long time — even text-davinci-002 wasn't actually RLHF, just SFT/FeedME, and looping text like this was rare at that point Issue here IMO is lack of EOT training; w/o that you need freq penalty etc
-

Weekly AI News Digest via Context Window Newsletter
By
–
my favorite way to catch up on what’s important in AI for the week is @TheHeroShep in @every
’s Sunday email, Context Window: -

Building and Learning from Early AI Agents: 2023 Insights
By
–
I am very grateful that we built an agent in 2023 and learned everything we could from how users used it. Showed us a low res version of the future.
-
Machine Learning System Detects Dark Vessels Faster Than Ever
By
–
Machine-learning system can detect dark vessels faster
#AI #AIio #BigData #ML #NLU #Futureofwork @chrismessina @ChristopherIsak @davidwkenny @debashis_dutta @petitegeek @fabiomoioli @GaryMarcus @asokan_telecom -
Best System at Scale Emerges Freely Without Better Alternatives
By
–
Best system we know of and it freely emerges at scale. So no point in dismissing it until you have something better that works. Vague generalities won’t do.
-
Better Systems Drive Progress Through Concrete Proposals
By
–
Some systems are objectively better than others. That’s how all progress is made. If you have something new and better, make concrete proposals and execute on them.
-

Wise Optimism About Science and Technology
By
–
How to be a wise optimist about science and technology? https://
bit.ly/4gO235d
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
DeepMind’s Role in UK AI: More Potential Ahead
By
–
yes, deepmind is the lighthouse for ai and has played such an immense role in the uk and beyond. no, it is not enough. the uk can do far more.
-
Staying at AI frontier: relevance imperative for organizations
By
–
I do agree that if you’re not at the frontier, it’s increasingly looking like you’re not relevant.