If I hit some pocket of supervision, but I think it's all emergent behaviour, I'll come away with an incorrect mental model about what else the system can do. I'll think, well if it can do this task, it can do this other task. 5
RESEARCH
-
Emergent Performance: Balancing Algorithm, Data, and Developer Supervision
By
–
If the performance on both tasks is emergent, I should think about the capabilities in terms of the algorithm and the data. But if the supervision is important, I need to include the developers in my mental model. 6
-
ChatGPT’s opacity regarding data sources and supervision
By
–
The fallback function of Siri, Alexa etc is to search Google or Wikipedia. When that happens, it's pretty obvious. But with ChatGPT, it's extremely murky (to me at least) — so much so that I don't even know how important the explicit supervision really is. 4
-
Distinguishing Emergent vs Supervised Behaviors in ChatGPT
By
–
Some of the things ChatGPT can do are emergent behaviours, picked up from the language or code modelling. Other things it can do have been specifically taught to it. Is there some speculative list somewhere about what tasks were supervised? 1
-
Understanding Emergent Capabilities in AI Technology
By
–
If we knew which capabilities are fully emergent, that would help a lot in guessing the trajectory of the underlying technology, and I'd find it a bit easier to use.
It's like when Siri came out and lots of people didn't get how it worked at all. 2 -
Neural Networks Enhance Character Learning with Visual Mnemonics
By
–
Check out this 2021 experiment by @azlenelza where characters were augmented with visual mnemonics with the help of neural networks, to make them easier to learn:
-
ChatGPT and generative AI models reshape digital landscape
By
–
While Peterson doesn't link #ChatGPT and the early deepfakes of him as part of the bigger trend of #GenerativeAI (most people don't) — he is right that ChatGPT is a huge deal, and only a very early application of the superior generative models on the horizon.
-
VALL-E Text-to-Speech Synthesis: Audio and Video Generation
By
–
How about generating audio and video? Something that we saw with VALL-E (Text-to-speech-synthesis): https://
valle-demo.github.io -
Sam Altman on AI for the Next Era insights and future directions
By
–
This source suggests the same, @sama brought this up in one of his podcast with Greylock ventures. AI for the next era: https://
greylock.com/greymatter/sam
-altman-ai-for-the-next-era/
… -
GPT-4 Multimodality: What Does It Really Mean?
By
–
GPT-4 will be Multimodal Very high chance that multimodality will lead the next generation of AI models. But, What does that really mean?