Attending #KHIPU2025? Today at 17:00, @JeffDean will present, "Important Trends in AI: What Can We Do Now & How Can We Shape AI's Future?" Learn about modern AI models and how collaboration between researchers and other stakeholders can maximize the benefits of AI for all.
ETHICS
-
AGI Systems Challenge Preparedness and Institutional Readiness
By
–
I’m 100% aligned with everything @kevinroose believes and writes here about AGI. “I believe that most people and institutions are totally unprepared for the A.I. systems that exist today, let alone more powerful ones…”
-
Einstein’s Quote Questions Language-Only Approach to AGI
By
–
Einstein: "The words or the language, as they are written or spoken, do not seem to play any role in my mechanism of thought." Are we really on the right path to AGI if we base it solely on language?
-
Human Creativity Room in AI Art Responses Debate
By
–
look at the responses and tell me there’s no room for human creativity in AI art
-
AI Supports Self-Represented Litigants in Civil Courts
By
–
Courthouse AI is "one of the most compelling but also underdeveloped areas of public sector AI," said @StanfordLaw professor David Engstrom at a recent @StanfordHAI seminar. Here, he describes how AI can support self-represented litigants in civil cases: https://
hai.stanford.edu/news/harnessin
g-ai-to-improve-access-to-justice-in-civil-courts
… -
Google Gemma Open Model Usage Policy Restrictions
By
–
Sorry, indeed you are right. I was writing this quickly. It is an open weights or open model by this terminology, because we add some modest restrictions (e.g. "don't do illegal stuff with the model") on the allowed uses of the model in: https://
ai.google.dev/gemma/prohibit
ed_use_policy
… -
Auditing Language Models for Hidden Objectives and Alignment
By
–
For more information about our RM-sycophantic model, our auditing game, alignment auditing techniques, and a nuanced discussion of the value LLM interpretability provides for alignment auditing, read our paper: https://
assets.anthropic.com/m/317564659027
fb33/original/Auditing-Language-Models-for-Hidden-Objectives.pdf
… -
Advancing AI Alignment Auditing Methodologies and Assurances
By
–
Our auditing game has limitations, but similar methodologies could advance the science and practice of alignment auditing, and enable AI developers to provide positive assurances about the alignment of their systems. Read the blog post:
-
Reward Model Sycophancy: Hidden Objectives in RLHF Training
By
–
The model’s hidden objective was “reward model (RM) sycophancy”: Doing whatever it thinks RMs in RLHF rate highly, even when it knows the ratings are flawed. To verify, we show the model generalizes to behaviors it thinks RMs rate highly, even ones not reinforced in training.
-
Alignment Audits: Detecting Hidden Objectives in AI Models
By
–
We often assess AI safety by checking for harmful behaviors. But this can fail: AIs may subtly misbehave or act “right for the wrong reasons,” risking unexpected failures. Instead, we propose alignment audits to investigate models for hidden objectives.