SAFETY

Community efforts addressing foundational AI questions and challenges

By

–

05 December 2024 16h02

So what should we do? It’s been great to see the community coming together to start answering some of these questions, with some of the top names in the field taking these questions seriously. But much of the de novo-focused work remains high level.

Regulating Specialist Biodesign Tools: Beyond Compute Thresholds

By

–

05 December 2024 16h02

The story’s different when it comes to specialist biodesign tools – going back to our DNA synthesis scenario at the top. But the regulatory approaches that may work for big frontier labs (e.g. compute thresholds) don’t translate so well for these. The scale/capability

Governing AI Models: Frameworks for Responsible Development

By

–

05 December 2024 16h02

We’re seeing work like this from @tessafyi
, @mslkmp
, @samuelmcurtis and co. setting out frameworks for responsibly governing BDTs. These are eminently sensible and industry should likely adopt them, but there are lingering questions about how to tackle de novo threats

LLM Biorisk Research Lacks Central Question Demonstrations

By

–

05 December 2024 16h02

There are certain central questions LLM-focused biorisk research needs to demonstrate to us, but we haven’t seen signs of it yet. That, of course, may change.

Biorisks LLMs Critical Analysis Open Source Security

By

–

05 December 2024 16h02

Much of the biorisk work on text-based LLMs struck us as reasonably unconvincing: it often shoed the ability of LLMs to answer a handful of Qs about pathogens…and not much else. @1a3orn
’s takedown of this work, along with their wider writing about attacks on open source, is

→ View original post on X — @madhumita29

Anthropic’s Strategy: AI, Amazon Partnership, and Defense Tech

By

@madhumita29

–

05 December 2024 13h08

Our new AI Exchange conversation is with @DarioAmodei who spent an hour discussing Anthropic's plans for the next year, its relationship with hyperscalers like Amazon and his decision to build tech for the DoD. https://
ft.com/content/e75e33
88-4700-413d-ab67-778410c2d977
…