AI performance measurement is ultimately vibes. Lots of people saying Claude 3 got worse. Anthropic says literally nothing major changed. It could be user misperception. It could be that minor change. Or cosmic rays. It could be that Claude subtly reacts to the Ides of April.
Claude 3 Performance Changes: Measurement Challenges and User Perception
By
–