I mean the best coders are using AI as part of their workflow, so I can't imagine an AI surpassing them
@rasbt
-
Preferring Manual Coding Over AI Code Assistants
By
–
I still have to fully embrace code assistant in my workflow. It's just that I enjoy coding too much .
I feel like driving a stick shift at this point . -
AI Code Generation Won’t Match Top Human Programmers by 2026
By
–
> and may match the best human coders by late 2026
No, unless you compare it to a human coder working offline. -
Speculation on AI Pin Company Acquisition for OS Development
By
–
Just speculating, but they probably could have accomplished this already by the end of the year by acquiring that AI pin company for their OS and apps stuff.
-
Text Data Handling for Building Large Language Models From Scratch
By
–
A new video in my “Build A Large Language Model From Scratch” series is now live. In this tutorial, I cover text data handling, which is an important component for both understanding and training LLMs.
In particular, the video walks through the following topics:
– The process of -
GPT-5 Likely Larger Than GPT-4 With Enhanced Training
By
–
My intuition is it's somewhere in between. Somewhat bigger than GPT-4, more training data, and some additional training methodology.
-
Is GPT-4o a Distilled and Quantized Version of GPT-4?
By
–
Maybe, but that begs the question: how much smaller is GPT-4o than GPT-4? I think GPT-4o is probably a heavily quantized and distilled or pruned model that took a while to develop based on GPT-4.
-
10X Pretraining Compute vs Model Size: Clarification on Scaling
By
–
He said "10X pretraining compute" which doesn't mean 10x bigger. It can well be the same size but use more training tokens, longer contexts, and other algorithmic changes.
-
Inferring Model Size from Speed and Pricing is Complex
By
–
I think model size is hard to infer from speed & pricing: it depends on – GPU type
– precision and quantization at inference
– batch scaling
– subsidized or not
– MoE or not
– etc. -
GPU Constraints May Limit GPT-4.5 Rollout at OpenAI
By
–
You mean GPUs? Yeah, well, it depends. OpenAI is a much bigger company with many more regular users now. Maybe o1 and Deep Research users are hogging so many GPUs that they can't roll out GPT-4.5 to as many as they would have liked. Without more info it's hard to say anything