> 2020: gpt2 can't write code
> 2021: gpt3 can't reliably write python
> 2022: instructgpt can't write blocks of code without syntax errors
> 2023: chatgpt can't do leetcode
> 2024: gpt4 can't debug CUDA
> 2025: gpt4o can't implement entire PR these LLMs are not to be trusted…
LLM Coding Capabilities: From GPT-2 to GPT-4o Progress
By
–