POLICY

Does AI Regulation Increase or Decrease Extinction Risk?

By

–

31 October 2023 23h41

Geoffrey do you think advocating for strong regulation will make human extinction more likely, or less likely? On what basis do you make that assessment?

AI Safety Policies May Undermine Protection Against Superintelligence

By

–

31 October 2023 23h39

AI Safety advocates are *not* really taking seriously the possibility of AI super intelligence. If you do really think that this is a danger, their main policy recommendations may make us much *less* safe. I explain why in this discussion:

→ View original post on X — @andrewyng

White House Defense Production Act Distorts AI Security Policy

By

@andrewyng

–

31 October 2023 23h02

Laws to ensure AI applications are safe, fair, and transparent are needed. But the White House's use of the Defense Production Act—typically reserved for war or national emergencies—distorts AI through the lens of security, for example with phrases like "companies developing any

Nuclear Weapons Analogy Relevance to AI Safety Concerns

By

–

31 October 2023 21h51

Geoffrey, that's a really weak analogy. I'm surprised you think it's relevant. Can you explain on what basis you feel like your understanding of nuclear weapons is relevant to the use of AI, and why the differences between the two are not relevant?

→ View original post on X — @andrewyng

Overhyped AI extinction fears discouraging students from field

By

@andrewyng

–

31 October 2023 21h39

I didn't say it is a conspiracy. But I think overhyped fears about AI leading to human extinction are causing real harm:
– I'm seeing young students discouraged from entering AI because they don't want to contribute to human extinction. – Hype about harm is also being used to

→ View original post on X — @stanfordhai

White House AI Executive Order Promotes Research Through NAIRR

By

@stanfordhai

–

31 October 2023 21h32

The new @WhiteHouse AI executive order promotes innovation and competition by catalyzing AI research through the National AI Research Resource (NAIRR). Since inception, @stanfordhai has been at the forefront of this discussion. Learn more about the NAIRR: https://
stanford.io/3se77My

OpenAI governance structures insufficient to prevent systemic issues

By

–

31 October 2023 21h19

Yes exactly – it's a natural result of how the system works, and is almost impossible to avoid. OpenAI clearly tried to avoid it but setting up various governance structures, but governance is insufficient to fix this.

Liability Claims in AI Policy Summary: Verification Discrepancy

By

–

31 October 2023 21h17

The word "liability" doesn't appear AFAICT on the web page, arxiv PDF, or policy supplement — but it is in your 5 point summary. Where are you getting that from? (Sorry if I'm missing something obvious!)

→ View original post on X — @geoffreyhinton

AI extinction risk probability estimates without regulation

By

@geoffreyhinton

–

31 October 2023 21h15

So what is your best estimate of the probability that if AI is not strongly regulated it will lead to human extinction in the next 30 years? If you are a true Bayesian you should be able to give a number. My current estimate is 0.1. I suspect Yann's is <0.01