Guess it’s time to revisit Superintelligence by Nick Bostrom. OpenAI is now talking beyond AGI. “Now is a good time to start thinking about the governance of superintelligence—future AI systems dramatically more capable than even AGI.”
REGULATION
-
10 Reasons to Worry About Generative AI
By
–
10 reasons to worry about generative #AI https://
bit.ly/3lC3L2j -
International AI Governance Framework: IAEA Model for Advanced AI
By
–
something like an IAEA for advanced AI is worth considering, and the shape of the tech may make it feasible: https://
openai.com/blog/governanc
e-of-superintelligence
… (and to make this harder to willfully misinterpret: it's important that any such regulation not constrain AI below a high capability threshold) -
International Oversight Organization for Superintelligence Governance
By
–
Initial ideas for governance of superintelligence, including forming an international oversight organization for future AI systems much more capable than any today:
-
OpenAI World Tour: Building and Policy Engagement Across Continents
By
–
had a great first week of the openai world tour in toronto, DC, rio, lagos, and lisbon. fun to see what people are building and get (lots of) feature requests, and even fun to talk to policymakers! madrid, warsaw, paris, london, and munich this week.
-
Open Source AI and External Audits Critical Requirements
By
–
De acuerdo con @antor en el tema open source. Hay bastante revuelo con ello (ver tuit más abajo).
En cuanto a las auditorías externas, no las calificaría de “accesorias” sino de imprescindibles -
Why AI Ethics Should Take Priority Over Development Halts
By
–
In an effort to minimize the risks of #AI, there’s been a recent call to halt its development. Here's why it's more beneficial to prioritize AI ethics instead: https://
ibm.co/426V1AQ -
Half of AI researchers estimate 10% extinction risk from AI
By
–
In a recent survey half of AI researchers gave at least 10% chance of human extinction due to AI. Have a read through this: https://
aiimpacts.org/2022-expert-su
rvey-on-progress-in-ai/
… -
Bureaucracies Cannot Distinguish Quality Alignment Research Papers
By
–
I don't think that does it, because the bureaucracies doing the funding wouldn't know how to distinguish good alignment papers from bad alignment papers. It's possible that some progress could be made on AI interpretability this way; but I don't think that's enough.
-
Balancing Short-term and Long-term AI Risk Assessment
By
–
I focused on both short term and long term risks, and made sure both were represented