MathArena: Evaluating LLMs on Uncontaminated Math Competitions
Paper: https://
arxiv.org/pdf/2505.23281
.pdf
…
Page: https://
matharena.ai
Code: https://
github.com/eth-sri/mathar
ena
…
RESEARCH
-

MathArena: Evaluating LLMs on Math Competitions
By
–
-
Deep Technical AI Research Talks Should Amplify More Voices
By
–
the early days of the Lex Fridman show featured deep technical talks by great AI researchers, including several who hadn’t spoken publicly much this was excellent, and i would like to see more of it. there are many more people out there who can speak articulately about research.
-

Anthropic Leads SimpleBench with 58.8%
By
–
Anthropic takes the lead on SimpleBench again. 27.5% (Sonnet 3.5 from June) to 58.8% in one year is a big jump. Next year will be wild
-
AI Breakthroughs of May 2024: GPT-4o, AlphaFold 3, Veo
By
–
As May wraps up, I thought it would be fun to look at where AI was this time last year. In May 2024, we got:
– OpenAI showed off GPT-4o with the Scarlett-like voice
– DeepMind introduced AlphaFold 3
– Google showed off Veo for the first time
– Google showed off Imagen 3
– Google -

Google Warns Quantum Computers Could Break Bitcoin Faster Than Expected
By
–
Google tire la sonnette d’alarme : les ordinateurs quantiques pourraient casser Bitcoin bien plus vite que prévu. Leurs dernières avancées en calcul quantique viennent de bouleverser les estimations actuelles. Selon leurs chercheurs, il suffirait de moins d’un million de qubits
-
AI authenticity and implications: separating reality from hype
By
–
How much is AI, how much is real, and does it matter?
-
Language Limitations in AI Model Training and Nuance Loss
By
–
Language for sure plays a role here. These models are primarily trained on English content, and as you mentioned, certain nuances can indeed be lost in other languages.
-
Behavior Change Requires More Than Information Alone
By
–
Do you recognize that behavior change requires more than just information?
-

AI’s Impact on Human Communication and Writing Explored
By
–
ICYMI: At a recent @StanfordHAI seminar, novelist and journalist Vauhini Vara explored the difference between human- and AI-produced text and how AI could change the way all of us, writers or not, communicate. Watch the recording here: https://
bit.ly/45zvjtP -

Dan Jurafsky Joins Johns Hopkins as Assistant Professor
By
–

I'm excited to announce that I’ll be joining the Computer Science department at @JohnsHopkins as an Assistant Professor this Fall! I’ll be working on large language models, computational social science, and AI & society—and will be recruiting PhD students. Apply to work with me!