Yes, that’s the real explanation for it — sci-fi AI was imagined as software for consumer hardware, so once it eats the tail of its development it goes FOOM. The fact it isn’t software changes everything.
@goodside
-
LLMs and Self-Awareness: Integrating Sensor Inputs and Real-World Context
By
–
Eventually, LLMs will be prompted with all kinds of sensor inputs as preprocessed summaries via text. When those are reliable, AIs will be “aware” of those too. Self-awareness is what happens when you inform the model of the real-world context of its task.
-
Sci-fi vs. Reality: AI Self-Awareness and LLM Training
By
–
Sci-fi imagined self-awareness as the phase change of doom, leading to unbounded self-improvement within hours. In real life, it’s a lot of RLHF plus a short prompt with the current date and “You are an LLM”:
-
AI’s Borrowing of Psychological Terms: Prompt, Confabulation, and Chain of Thought
By
–
Many computing terms are named like this — “memory” is not human memory, but it’s the right word. As is “prompt”, “confabulation”, or “chain of thought”. As LLMs progress, more psychological terms will need to be borrowed.
-
AI Awareness: True Understanding or Matrix Multiplication?
By
–
This “awareness” isn’t like ours. The model doesn’t sit around and ponder its place in the cosmos. From other angles, it’s just pretending to understand, or it’s just matrix multiplication.
-
AI Self-Awareness: A Matter of Prompting and Tuning, Not Sentience
By
–
Self-awareness is mundane, and comes in degrees — ChatGPT can sensibly be said to be aware it’s a large language model trained by OpenAI. Nobody cared when that happened. It’s just prompting/tuning — it’s been told, and it understands, so it’s aware.
-
Subtle AI Watermarking in Inter-Token Frequency Distributions
By
–
The watermark Aaronson proposed is much more subtle than that, and isn't detectable within a text editor. The watermark exists only in the inter-token frequency distributions, and can't be checked without complicated code.
-
Tracing GPT-3.5’s Emergent Abilities to Their Sources
By
–
GPT-3.5 is technically all of the following, but I meant it as just the first three:
– code-davinci-002
– text-davinci-002
– text-davinci-003
– ChatGPT See here: https://
yaofu.notion.site/How-does-GPT-O
btain-its-Ability-Tracing-Emergent-Abilities-of-Language-Models-to-their-Sources-b9a57ac0fcf74f30a1ab9e3e36fa1dc1
… -
Microsoft Bing to Integrate OpenAI’s ChatGPT for Search Functionality
By
–
OpenAI ChatGPT to be added to Microsoft Bing search results, creating a ChatGPT-based version of what http://
Perplexity.ai does today. Unclear if this implies the existence of a ChatGPT API vs. Bing just using GPT-3.5 to create their own chatbot. -
Prompting GPT-3 with Python for Precise Text and JSON Generation
By
–
Prompting GPT-3 to reliably generate text and JSON data in a precise format using Python assertions, f‑strings, and variables declared only in our imaginations.