Scott Aaronson describes an interesting approach to watermarking text generated by large language models to help discourage abuse. A similar approach could be used for images as well.
RESEARCH
-
LLMs and Self-Awareness: Integrating Sensor Inputs and Real-World Context
By
–
Eventually, LLMs will be prompted with all kinds of sensor inputs as preprocessed summaries via text. When those are reliable, AIs will be “aware” of those too. Self-awareness is what happens when you inform the model of the real-world context of its task.
-

Sci-fi vs. Reality: AI Self-Awareness and LLM Training
By
–
Sci-fi imagined self-awareness as the phase change of doom, leading to unbounded self-improvement within hours. In real life, it’s a lot of RLHF plus a short prompt with the current date and “You are an LLM”:
-
AI’s Borrowing of Psychological Terms: Prompt, Confabulation, and Chain of Thought
By
–
Many computing terms are named like this — “memory” is not human memory, but it’s the right word. As is “prompt”, “confabulation”, or “chain of thought”. As LLMs progress, more psychological terms will need to be borrowed.
-
AI Awareness: True Understanding or Matrix Multiplication?
By
–
This “awareness” isn’t like ours. The model doesn’t sit around and ponder its place in the cosmos. From other angles, it’s just pretending to understand, or it’s just matrix multiplication.
-
AI Self-Awareness: A Matter of Prompting and Tuning, Not Sentience
By
–
Self-awareness is mundane, and comes in degrees — ChatGPT can sensibly be said to be aware it’s a large language model trained by OpenAI. Nobody cared when that happened. It’s just prompting/tuning — it’s been told, and it understands, so it’s aware.
-
Podcast distinguishing medicine from quackery saves lives
By
–
This podcast can save your life. It helped me distinguish between medicine and quackery. Do listen.
-
Understanding the Roundworm Brain Despite Complete Neural Mapping
By
–
We've known the roundworm's full wiring diagram for decades and can simultaneously record the activity of all of its 302 neurons, but we're still far from understanding how it works.
-
Smart People Use AI to Challenge Their Own Ideas
By
–
Love this counterpoint. The smartest people will ask the AI to argue against their ideas the most often. Just as in life, the most rigorous thinking comes from viewing any issue from multiple points of view.
-
Baidu Research Reveals Top 10 Tech Trends for 2023
By
–
Baidu Research Releases Top 10 Tech Trends for 2023
