Last Fall, the word in SF was that GPT-4 was already AGI. Etc etc. Now it's just a monthly thing.
GENERATIVE AI
-
Why We Need New Technologies: The Coming Wave
By
–
We pursue new technologies, including those in the coming wave, not just because we want them, but because, at a fundamental level, we need them. http://
the-coming-wave.com -
Teaching Grok AI to correct its errors
By
–
Looks like you will be able to teach Grok AI why he was wrong exactly 👀 https://t.co/Gpd7LD3I5O
— 🚨 AI News | TestingCatalog (@testingcatalog) 23 novembre 2023Looks like you will be able to teach Grok AI why he was wrong exactly
-
Yi-34B-Chat: New State-of-the-Art Open Source Language Model
By
–
Yi-34B-Chat is a new chat model trained from scratch by @01AI_Yi
. It's currently the state-of-the-art open source language model on almost every benchmark. Try it out on Replicate: https://
replicate.com/01-ai/yi-34b-c
hat
… Or run Yi with an API: -
OpenAI’s Use of Synthetic Data and Q* Development
By
–
While OAI already uses 90% synth data lel. Q* ftw
-
Minimal Code Architecture Enables Massive Learning
By
–
The code that specifies the architecture is tiny.
That's precisely my point.
There is a tiny amount of prior structure and a lot of learning. -
Language Hardwiring Constraints Within 8MB Memory Limits
By
–
Whatever "hardwiring" is required for language has to fit in 8MB.
-
Sensory Data and Multimodal Learning in AI Development
By
–
Yes, that's one of my points.
Text is insufficient.
We need sensory inputs to learn how the world works.
We can estimate the total amount of visual data seen by a 2 year-old: 2 years = 2x365x12x3600 or roughly 32 million seconds.
We have 2 million optical nerve fibers, carrying -
Karpathy’s LLM Technical Explainer: Essential 101 Guide
By
–
3 different people have sent me this video in under 24hrs, so I watched it and can confirm this is a VERY clear, accessible and spot on practical technical explainer of LLMs… great 101… by the ever-awesome @karpathy – highly recommended