In a recent survey half of AI researchers gave at least 10% chance of human extinction due to AI. Have a read through this: https://
aiimpacts.org/2022-expert-su
rvey-on-progress-in-ai/
…
AGI
-
Half of AI researchers estimate 10% extinction risk from AI
By
–
-
AI Deception Risk: Smart Systems Can Fake Benevolence Like Humans
By
–
This approach fails for appointing benevolent human dictators to run our governments for us, because humans are smart enough to be pretend to be nicer than they are. So checking the apparent subservience of AIs isn't a reliable indicator once they're smart enough to fake that.
-
Simplifying AGI Definition for Business Leaders
By
–
This is an interesting way to define AGI. I kind of like it. It seems like AI researchers really struggle to agree on a universal definition of AGI, so I’m always looking for a way to simplify the concept for business leaders and professionals.
-
Balancing Short-term and Long-term AI Risk Assessment
By
–
I focused on both short term and long term risks, and made sure both were represented
-
Optimization creates minds with desires through evolution
By
–
If you optimize hard enough over any open-ended problem, you get minds; minds that want things. Minds and wanting are effective ways of computing complicated answers. That's how humans, and human brains, came into existence just from evolution hill-climbing "how to reproduce".
-
General intelligence versus specialized AI systems in chess
By
–
You could imagine Magnus Carlsen pouring water onto the Stockfish computer, because he's much more general than Stockfish even if he's not as good as chess. Harder for a 10-year-old to do to Magnus Carlsen, who also knows more about the world beyond the chessboard.
-
Advanced AI Independence from Biological Systems and Proteins
By
–
That It doesn't need current protein systems (life forms) to do anything, including think for It. It can make different life forms. It can make better proteins. It can make life not out of amino acids. So It doesn't need wheat, cows, or humans.
-
AI Progress Toward Human-Level Intelligence Accelerating Rapidly
By
–
The manufacturers who say they want to build Magnus Carlsens have been making a terrifying amount of recent progress, even though they're not there yet, and eyeballing the rate of things, it looks more like 0-2 breakthroughs than 20 of them.
-
Superior Intelligence Eliminates Need for Biological Cooperation
By
–
If something is not just smarter than humanity, but smarter than the cumulative optimization power of evolution, there's no humans It needs to trade with or animals It needs to raise or plants It needs to cultivate; anything life does, It can design better alternatives for.
-
AI Course Launch: Comprehensive 6-Session Weekend Program
By
–
Course will go live end of June – format will be 2 hours on Saturdays & Sundays for 3 weekends total. We'll go broad and deep!