With open-ended evals you mean free-form answers (and measuring conversational performance)?
GENERATIVE AI
-

Scaling Parallel Agents for Computer Use Tasks
By
–
what if we stopped betting everything on one agent rollout? "The Unreasonable Effectiveness of Scaling Agents for Computer Use" Generates multiple trajectories in parallel & selects the best using "behavior narratives" 69.9% on OSWorld, nearly matching human-level 72%
-

GPT-5 Energy Consumption Rivals Small Nations at 16.4 TWh
By
–
GPT-5 consomme autant qu’un pays entier, il se classe 81ᵉ mondial en consommation d’électricité. Sa consommation annuelle estimée est d’environ 16,4 TWh, soit bien plus que celle de la Slovénie.
-
Debating Core Analogies: Understanding AI’s Impact and Nature
By
–
I guess I would be remiss for not including other analogies that get debated here: the eschaton or the home computer? The atom bomb or crypto? A child or a plagiarism machine?
-
AI Analogy Problems: Disagreements About LLM Nature and Impact
By
–
Many of the disagreements over AI are analogy problems: is an LLM a brain or parrot? Will its effects on productivity be electrification or internet? Is the build-out of AI capability like the cloud or the 1880s railroad boom-and-bust? No one analogy fits, so we fight over them.
-
Grok Imagine AI app launches with new download version
By
–
Try the new Grok Imagine by downloading the latest app version https://
x.com/lyn_beatz/stat
/lyn_beatz/status/1974743593836589567
… -

Grokipedia Early Beta Version Launching in Two Weeks
By
–
Version 0.1 early beta of Grokipedia will be published in 2 weeks
-
Unified Architecture Different Parameters Activations
By
–
Unify in architecture, not in details. The parameters/activations will be different.
-
X.ai LLM Trainers Competence Assessment
By
–
I am sure that http://
x.ai has more competent LLM trainers than me