Evaluations are essential to understanding how models perform in health settings. HealthBench is a new evaluation benchmark, developed with input from 250+ physicians from around the world, now available in our GitHub repository.
RESEARCH
-
Universe as Mathematical Object: Numbers and Structural Foundation
By
–
Once you got numbers and ways to move between them, you can build a universe. If we accept that mathematical objects are not per default nonexistent, it makes sense to regard the universe as a mathematical object.
-
Collaborative Reasoner: Framework for Social Agents and Human Partnership
By
–
Introducing Collaborative Reasoner: a framework to improve collaborative reasoning in language models.
— AI at Meta (@AIatMeta) 12 mai 2025
Collaborative Reasoner paves the way for developing social agents that can partner with humans and other agents.
Read the research paper and download the code.… pic.twitter.com/btqd8RKcidIntroducing Collaborative Reasoner: a framework to improve collaborative reasoning in language models.
Collaborative Reasoner paves the way for developing social agents that can partner with humans and other agents. Read the research paper and download the code. -
Meta Releases 8B Dynamic Byte Latent Transformer Model Weights
By
–
We’re releasing model weights for our 8B- parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability.
— AI at Meta (@AIatMeta) 12 mai 2025
Learn more about how Dynamic Byte Latent… pic.twitter.com/1XUtTpq95SWe’re releasing model weights for our 8B- parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. Learn more about how Dynamic Byte Latent
-
Best AI Benchmark: Beyond Standard Arenas
By
–
Oubliez LM ARENA, aime 2025, et compagnie.
— VISION IA (@vision_ia) 12 mai 2025
Le meilleur benchmark pour tester une IA, c'est ça : pic.twitter.com/eLROfRRtBTOubliez LM ARENA, aime 2025, et compagnie. Le meilleur benchmark pour tester une IA, c'est ça :
-

AI Model Performance Gap Narrows to 0.7% in 2025
By
–
The frontier of AI development is increasingly crowded and competitive, with performance gaps shrinking rapidly. According to the #AIIndex2025, only 0.7% separates the top-performing model from the 10th-ranked model. Check out more AI data and takeaways: https://
stanford.io/434y597 -
Microsoft and Google Report 30% AI-Generated Code Achievement
By
–
Microsoft and Google claim they're already at 30% for all new code… so not long
-
Reasoning Tokens for Search and Information Retrieval
By
–
Reasoning Tokens Not for Needles, but for Haystacks
-

Neuro-Symbolic Concept-Centric Agents for General Intelligence
By
–
Concept-Centric Agents: A Neuro-Symbolic Shift in General Intelligence MIT and Stanford researchers proposes a concept-centric paradigm for building generalist agents capable of continual learning and flexible reasoning. Core idea: Neuro-symbolic concepts (e.g.,
-
CTM Implementation with ImageNet Pre-trained Model Checkpoints
By
–
Implementation of CTMs, with checkpoints of pre-trained models on ImageNet: