REGULATION

→ View original post on X — @anthropicai

ARC advances AI alignment evaluation and security measurement

By

@anthropicai

–

22 March 2023 16h57

We strongly agree there’s much more work to be done on alignment, security, and measurement. You can read about ARC’s specific approach to evaluation here: https://
evals.alignment.org/blog/2023-03-1
8-update-on-recent-evals/
…

→ View original post on X — @drhassanrashidi

Who Should Decide How AI Systems Behave?

By

@drhassanrashidi

–

22 March 2023 15h15

How Should AI Systems Behave, and Who Should Decide? https://
openai.com/blog/how-shoul
d-ai-systems-behave
… @ASMEdotorg @3DSNorthAmerica @MargaretSiegien @3DSdelmia @3DStherese @Cindybolt61 @fogoros @DrFerdowsi @CRudinschi @PawlowskiMario @IIoT_World @MEngineeringMag #Science #Engineering #Technology #SET

Black Box AI Systems: The Reproducibility and Transparency Crisis

By

–

22 March 2023 13h52

Without knowing how these systems are built, there is no reproducibility. You can't test or develop mitigations, predict harms, or understand when and where they should not be deployed or trusted. The tools are black boxed.

Model Safety: Mitigation Without Full Release, Transparency Needed

By

–

22 March 2023 13h52

There's a lot of ways to mitigate harms without having to publicly release the entire model. There are many papers on auditing, datasheets, transparency etc. With GPT3 we knew the training data. With GPT4 we don't. Without that, we're all looking at shadows in Plato's cave.

Lack of Transparency in AI Model Training Data

By

–

22 March 2023 13h52

There is a real problem here. Scientists and researchers like me have no way to know what Bard, GPT4, or Sydney are trained on. Companies refuse to say. This matters, because training data is part of the core foundation on which models are built. Science relies on transparency.

→ View original post on X — @thegautamkamath

Google’s Bard Error Claims Face Credibility Questions

By

@thegautamkamath

–

22 March 2023 3h32

To be clear, I'm taking their claim at face value for now. But I find it funny that the only way to emphasize that it isn't trained on Gmail data, is to state that it can make mistakes. A lose-lose situation, esp given the history https://
theverge.com/2023/2/8/23590
864/google-ai-chatbot-bard-mistake-error-exoplanet-demo
…

Google Confirms No Private Data Used in Training

By

–

22 March 2023 0h24

So Google has responded to say that no private data was used in training. Good to have this confirmed on the record. (Maybe it’s Barb to its friends) https://
x.com/GoogleWorkspac
/GoogleWorkspace/status/1638312370534600705
…