Final update! MMLU is saturated and has become (rightfully) less popular. What should replace it? – Other knowledge evals like GPQA, MMLU-Pro
– Code evals like LiveCodeBench
– Agentic evals like BFCL
– Other?
GENERATIVE AI
-

What Should Replace MMLU for AI Model Evaluation?
By
–
-

AI Trends: Synthetic Actors, Siri Chatbot, and Enterprise Costs
By
–
Top stories in AI today: – AI actress Tilly Norwood nears talent deal
– Apple’s internal ChatGPT-style Siri app
– Build an AI calendar agent using n8n
– AI ‘workslop’ costing companies millions
– 4 new AI tools, community workflows, and more Read more: https://
therundown.ai/p/hollywoods-s
ynthetic-actor-showdown
… -
GATO Project: Building a Generalist Agent Model with GPT
By
–
Thank you … this certainly was and still is one of my favourite projects. The moment @scott_e_reed and I saw GPT we started working on Generalist AgenT One (GATO). We strongly believed a model could do anything a human could do from motor control, to perception, generation,
-

DeepSeek-V3.2-Exp: 50% Cheaper, Better Search
By
–



DeepSeek released DeepSeek-V3.2-Exp build on top of previously released V3.1-Terminus model. It is 50% cheaper and slightly better at search benchmarks. Deep dumping
-

AI Evaluation Shift: From Recognition Tasks to Economic Value Metrics
By
–
Hace 10 años evaluábamos a la IA por su capacidad de leer textos sencillos o reconocer perros/gatos en imágenes. En 2025, con benchmarks como el nuevo GDPval, se evalúa por su capacidad de resolver tareas económicamente valiosas que contribuyan al PIB. ¡El salto de una década!
-
ChatGPT parental access teen conversations safety policy
By
–
Will parents have access to their teen’s conversations in ChatGPT? Parents don’t have access to their teen’s conversations, except in rare cases where our system and trained reviewers detect possible signs of serious safety risk, parents may be notified — but only with the
-
ChatGPT Parental Controls: Teen Account Linking Requirements
By
–
Do teens have to opt-in to parental controls in ChatGPT? A parent or teen can send an invitation to link their accounts in parental controls, and the other party needs to accept the invitation to get set up. Parents will be notified if their teen disconnects their account.
-
ChatGPT Launches Parental Controls Resource Page for Guidance
By
–
We’ve worked closely with experts, advocacy groups, and policymakers to help inform our approach—we expect to refine and expand on these controls over time. As part of that work, we’ve launched a new resource page to help parents understand and guide how ChatGPT works in their
-
ChatGPT Launches Parental Controls for Teen Account Safety
By
–
Introducing parental controls in ChatGPT.
— OpenAI (@OpenAI) 29 septembre 2025
Now parents and teens can link accounts to automatically get stronger safeguards for teens. Parents also gain tools to adjust features & set limits that work for their family.
Rolling out to all ChatGPT users today on web, mobile soon. pic.twitter.com/kcAB8fGAWGIntroducing parental controls in ChatGPT. Now parents and teens can link accounts to automatically get stronger safeguards for teens. Parents also gain tools to adjust features & set limits that work for their family. Rolling out to all ChatGPT users today on web, mobile soon.
-
ChatGPT Parental Controls: Content Safeguards for Teens
By
–
What features will parents have the ability to adjust with parental controls in ChatGPT? -Reduce sensitive content: the ability to add extra safeguards to help protect teens, such as graphic content and viral challenges. This setting is on by default when a teen is connected.