Dear ChatGPT, Am I the Asshole? While Reddit users might say yes, your favorite LLM probably won’t. We present Social Sycophancy: a new way to understand and measure sycophancy as how LLMs overly preserve users' self-image.
@jurafsky
-
LLMs for Health Equity: Beyond Harms to Opportunities
By
–
Our article on using LLMs to improve health equity is out in @NEJM_AI! 85% of equity-related LLM papers focus on *harms*. But equally vital are the equity-related *opportunities* LLMs create: detecting bias, extracting structured data, and improving access to health info.
-
New January 2025 Release of Speech and Language Processing
By
–
Happy New Year everyone! Jim and I just put up our January 2025 release of Speech and Language Processing! Check it out here: web.stanford.edu/~jurafsky/s…
-
AI Community Needs Evidence-Based Policy Consensus
By
–
The AI community lacks consensus on AI policy. With colleagues across academia, we argue that we need to advance scientific understanding to build evidence-based AI policy. understanding-ai-safety.org/
-
Content Moderation Algorithms Wrongly Flag Racism Stories as Toxic
By
–
Content moderation algorithms can mistakenly flag stories of experiencing racism as toxic content. Human users also flag discrimination disclosures for removal more often than stories about negative interpersonal experiences that don’t involve race. PNAS: ow.ly/f9v850TmWCp
-
LLMs Generate Covert Racism Based on Dialect Features
By
–
Beyond excited to share that this is now out in @Nature! We show that despite efforts to remove overt racial bias, LLMs generate covertly racist decisions about people based on their dialect. Joint work with amazing co-authors @ria_kalluri, @jurafsky, and Sharese King. Valentin Hofmann (@vjhofmann) 💥 New paper 💥 We discover a form of covert racism in LLMs that is triggered by dialect features alone, with massive harms for affected groups. For example, GPT-4 is more likely to suggest that defendants be sentenced to death when they speak African American English. 🧵 — https://nitter.net/vjhofmann/status/1764687418626576445#m
-
Fall 2024 Draft Chapters Released for Speech and Language Processing
By
–
It's back-to-school time and so here's the Fall '24 release of draft chapters for Speech and Language Processing! web.stanford.edu/~jurafsky/s…
-
CausalGym Wins Area Chair and Outstanding Paper Awards at ACL
By
–
causalgym won an area chair award and outstanding paper award at ACL 😁 thanks to my very cool advisors @ChrisGPotts and @jurafsky