A good test for very high machine intelligence would be the ability to create satisfying puzzles that are coherent, thematic, and appropriate for the level of the solver. I know some amazing puzzle designers, their work takes lots of effort and testing. Can AI eventually do it?
MACHINE LEARNING
-
Self-Attention Mechanism: How Key, Query, and Value Matrices Work
By
–
Jokes apart! It explains how key, query & value matrices combine in the self attention mechanism. Here’s an illustration of the same:
-
NLP for Misinformation Tracking: Framing the Research Challenge
By
–
I think there might be uses for NLP in tracking/disrupting the spread of misinformation, but today I'd say that we need to start with a larger frame (e.g. one provided by people who study that spread & the behaviors behind it) and then ask: where can NLP help?
-
Sensory Streams Analysis: Underappreciated Touch Modality
By
–
This is a good analysis of sensory streams by @ylecun
. I love these back of the envelope estimates. Also, great point about touch, a modality that I feel is under appreciated. -
Generative Models Advancing Across Health, Weather, History, Mathematics
By
–
Had so much fun at this RAAIS day! We’ve come far since 2018 and generative models now doing amazing things in health and weather and history and maths and more. Generative models and probabilistic thinking still so important! Thanks for the great walk down memory lane
-
Emergent LLM Abilities: Gradual Path to AGI
By
–
When we get to AGI, it will have come slowly, not overnight. A NeurIPS Outstanding Paper award recipient, Are Emergent Abilities of Large Language Models a Mirage? (by @RylanSchaeffer
, @BrandoHablando
, @sanmikoyejo
) studies emergent properties of LLMs, and concludes: "… -
Training LLMs from Ground Zero: Compute Procurement Insights
By
–
Amazing new blogpost by @YiTayML on training LLMs in the wilderness from the ground up Blog post link https://
yitay.net/blog/training-
great-llms-entirely-from-ground-zero-in-the-wilderness
… *****************
In this blog post, he discussed:
1. Experiences in procuring compute & variance in different compute providers. Our -
ProteinDT and MoleculeSTM Featured in AI Research
By
–
Thank you for featuring ProteinDT and MoleculeSTM @Shengchao_Liu
-
Understanding Deep Learning: Comprehensive eBook Guide Released
By
–
[Download 541-page PDF eBook] Understanding #DeepLearning: http://
udlbook.github.io/udlbook/ by @SimonPrinceAI V/ @KirkDBorne #AI #artificialintelligence #genai #BigData #DataScience #LLM #ML #MachineLearning #NeuralNetworks #ReinforcementLearning #NLProc #ComputerVision #Algorithms -
Unifying Large Language Models and Knowledge Graphs: Research Roadmap
By
–
Unifying Large Language Models and Knowledge Graphs: A Roadmap Pan et al.: https://
arxiv.org/abs/2306.08302 #LargeLanguageModels #LLMs #KnowledgeGraphs