i agree on being close to dangerously strong AI in the sense of an AI that poses e.g. a huge cybersecurity risk. and i think we could get to real AGI in the next decade, so we have to take the risk of that extremely seriously too.
AGI
-
AI Value Alignment: Users vs Creators Intent Debate
By
–
interesting watching people start to debate whether powerful AI systems should behave in the way users want or their creators intend. the question of whose values we align these systems to will be one of the most important debates society ever has.
-
ChatGPT capabilities debate exponential AI progress trajectory
By
–
interesting to me how many of the ChatGPT takes are either "this is AGI" (obviously not close, lol) or "this approach can't really go that much further". trust the exponential. flat looking backwards, vertical looking forwards.
-
Deep RL at Peak Hype in 2016, AGI Hopes
By
–
Deep RL was at peak hype during NIPS2016. Everyone thought training a ConvNet to play a few Atari games using Q-Learning would lead to AGI.
-
Artificial Narrow Intelligence Versus Artificial General Intelligence Comparison
By
–
#Infographic: Artificial Narrow Intelligence Vs Artificial General Intelligence by @ingliguori #ArtificialIntelligence #ComputerScience #AI #smartmachines #AGI #NarrowAI #MachineLearning #DeepLearning #DataScience #RPA #NeuralNetworks #Robots #Bot #DigitalTwins #ModelOps #MLOps
-
Consciousness: Self-Awareness and Environmental Awareness in AI Systems
By
–
Consciousness is a combination of self and environmental awareness. I see environmental awareness in Minedojo as tractable but self-awareness is a different story. For that, you need uncertainty quantification is key: unknown unknowns is tricky.
-
AI Assistants Evolution: From Conversation to Knowledge Discovery
By
–
soon you will be able to have helpful assistants that talk to you, answer questions, and give advice. later you can have something that goes off and does tasks for you. eventually you can have something that goes off and discovers new knowledge for you.
-
Transformer: The Critical Unlock Technology for General-Purpose AI
By
–
So the first critical "unlock technology" is the Transformer, a neural net architecture powerful enough to become a general-purpose computer. I've written more about this here: 1) https://
x.com/karpathy/statu
s/1582807367988654081
… and 2) -
EA Tweetstorm: Effective Altruism and AI Ethics Debate
By
–
i've been stopping myself from sending my EA tweetstorm for a week but idk how much more self-restraint i have
-
AI Safety and Capability Are Not Orthogonal Vectors
By
–
it's a dangerous myth that AI safety and AI capability are orthogonal vectors. also a myth that we can "avoid ruin" without careful iteration and contact with reality. things have not gone as our best experts have predicted, and that will continue to be the case.