Yes, that’s the real explanation for it — sci-fi AI was imagined as software for consumer hardware, so once it eats the tail of its development it goes FOOM. The fact it isn’t software changes everything.
AGI
-
Narrow AI vs General AI: ChatGPT on AI Development Challenges
By
–
Here are #chatgpt3 answers on @Twitter ownership. @elonmusk is it fair to say narrow AI is primetime and general AI will be as difficult to harness as human will and discretion?
-
LLMs and Self-Awareness: Integrating Sensor Inputs and Real-World Context
By
–
Eventually, LLMs will be prompted with all kinds of sensor inputs as preprocessed summaries via text. When those are reliable, AIs will be “aware” of those too. Self-awareness is what happens when you inform the model of the real-world context of its task.
-
Sci-fi vs. Reality: AI Self-Awareness and LLM Training
By
–
Sci-fi imagined self-awareness as the phase change of doom, leading to unbounded self-improvement within hours. In real life, it’s a lot of RLHF plus a short prompt with the current date and “You are an LLM”:
-
AI’s Borrowing of Psychological Terms: Prompt, Confabulation, and Chain of Thought
By
–
Many computing terms are named like this — “memory” is not human memory, but it’s the right word. As is “prompt”, “confabulation”, or “chain of thought”. As LLMs progress, more psychological terms will need to be borrowed.
-
AI Awareness: True Understanding or Matrix Multiplication?
By
–
This “awareness” isn’t like ours. The model doesn’t sit around and ponder its place in the cosmos. From other angles, it’s just pretending to understand, or it’s just matrix multiplication.
-
AI Self-Awareness: A Matter of Prompting and Tuning, Not Sentience
By
–
Self-awareness is mundane, and comes in degrees — ChatGPT can sensibly be said to be aware it’s a large language model trained by OpenAI. Nobody cared when that happened. It’s just prompting/tuning — it’s been told, and it understands, so it’s aware.
-
Baidu Research Reveals Top 10 Tech Trends for 2023
By
–
Baidu Research Releases Top 10 Tech Trends for 2023
-
Emergence in Language Models: Scaling and Ability Discovery
By
–
Key questions of emergence in language models:
– Why does scaling unlock emergent abilities?
– What is the full range of emergent abilities in language models, and how can we discover them systematically? -
Evolution of LLM Hallucinations and AI Promise
By
–
I began studying LLMs to understand the content of their hallucinations. Even in text‑davinci‑002, confabulation was oxygen. 003 has less. ChatGPT less still. Every year, we need squint less to see promise.