Our Preparedness Team will drive technical work, pushing the limits of our cutting edge models to run evaluations and closely monitor risks, including during training runs. Results will be synthesized in scorecards that track model risk.
SAFETY
-
ChatChaos: Stress Testing LLMs with Chaos Engineering
By
–
Chaos Engineering The behavior of LLMs can be unpredictable and chaotic ChatChaos is a fake LLM by @andrewnguonly specifically designed to return invalid JSON, hallucinate, and have long response times Can be used to stress test your system! Blog:
-
Prioritizing Current AI Solutions Over Long-term Speculation
By
–
I’m with @ylecun and @AndrewYNg on this. I feel it is more responsible to devote greater effort to solving today’s problems (e.g. climate, health, energy, poverty, safety, communication, bias and discrimination, education) than to cultist AI long term speculation.
-
Engineering Over Theory: Building Reliable Systems Without Perfect Proof
By
–
There is no math that proves that there exist a way to make safe and reliable turbojets.
Yet we do make turbojets that are incredibly safe and reliable.
It's called engineering.
You should try it. -
Meta’s Ethical Considerations for AI Product Deployment
By
–
Meta is asking itself this kind of questions literally *every* *single* *time* a product is under consideration for deployment.
-
Turbojet Safety: Engineers’ Responsibility Without External Pressure
By
–
Engineers and scientists who have made turbojets as safe and reliable as they are today haven't specifically worked on "turbojet safety," nor have they been required to "acknowledge there is a problem to be solved" by mobs of random people claiming they weren't doing their job
-
Hypothetical AI Harms Versus Current Realized Harms Imbalance
By
–
In AI, the ratio of attention on hypothetical, future, forms of harm to actual, current, realized forms of harm seems out of whack. Many of the hypothetical forms of harm, like AI "taking over", are based on highly questionable hypotheses about what technology that does not
-
Nuclear Weapons vs AI: Understanding Design Intent Differences
By
–
Nuclear weapons are designed to wipe out entire cities.
AI is designed to amplify human intelligence.
See the difference? -
Safe Technology Deployment Path Will Prevail Over Unsafe Alternatives
By
–
No.
I'm claiming that if there is a way to build and deploy a technology in a safe way, that's the way it will happen.
The fact that there are zillions of ways to build unsafe versions of it is completely irrelevant.
Just like with turbojets. -
AI Safety Debate: Comparing Risks to Established Technologies
By
–
BS.
1. Turbojets actually enable the destruction of entire cities by bombing. Yet we still build turbojets.
2. There is exactly zero evidence that AI can ever cause the kind of destruction you allude to.