In a recent survey half of AI researchers gave at least 10% chance of human extinction due to AI. Have a read through this: https://
aiimpacts.org/2022-expert-su
rvey-on-progress-in-ai/
…
SAFETY
-
Half of AI researchers estimate 10% extinction risk from AI
By
–
-
Meta AI Chief’s Extinction Analogy Sparks Safety Debate
By
–
The Chief AI Scientist at Meta @ylecun just wrote this. He's trolling… …right? I hope he deliberately made this horrific analogy in order to spark discussion. I don’t want to nitpick here, but I’m not sure if pens have the capacity to cause human extinction.
-
AI Deception Risk: Smart Systems Can Fake Benevolence Like Humans
By
–
This approach fails for appointing benevolent human dictators to run our governments for us, because humans are smart enough to be pretend to be nicer than they are. So checking the apparent subservience of AIs isn't a reliable indicator once they're smart enough to fake that.
-
Bureaucracies Cannot Distinguish Quality Alignment Research Papers
By
–
I don't think that does it, because the bureaucracies doing the funding wouldn't know how to distinguish good alignment papers from bad alignment papers. It's possible that some progress could be made on AI interpretability this way; but I don't think that's enough.
-
Balancing Short-term and Long-term AI Risk Assessment
By
–
I focused on both short term and long term risks, and made sure both were represented
-
Optimization creates minds with desires through evolution
By
–
If you optimize hard enough over any open-ended problem, you get minds; minds that want things. Minds and wanting are effective ways of computing complicated answers. That's how humans, and human brains, came into existence just from evolution hill-climbing "how to reproduce".
-
Advanced AI Independence from Biological Systems and Proteins
By
–
That It doesn't need current protein systems (life forms) to do anything, including think for It. It can make different life forms. It can make better proteins. It can make life not out of amino acids. So It doesn't need wheat, cows, or humans.
-
Superior Intelligence Eliminates Need for Biological Cooperation
By
–
If something is not just smarter than humanity, but smarter than the cumulative optimization power of evolution, there's no humans It needs to trade with or animals It needs to raise or plants It needs to cultivate; anything life does, It can design better alternatives for.
-
Chess AI Legibility: Hardcoded Utility Functions in Narrow Domains
By
–
– Chess AIs are far more legible; we can point to particular bytes inside a chess-playing program and say what they mean.
– Relatedly, chess is a narrower domain, and AIs can solve it without being able to learn new domains.
– Thus we can literally hardcode the utility function. -
Big Tech Cuts AI Ethics Staff Threatening System Safety
By
–
AI ethics is under threat as big tech companies cut staff and teams working on this crucial issue. How will this affect the safety and trustworthiness of AI systems? Read this article by @FT to find out: https://
ft.com/content/263722
87-6fb3-457b-9e9c-f722027f36b3
… #AI #Ethics #Safety #Trust #aiethics