i sample tokens based on average frequency and prompt with 1 token
LLMS
-
LLM Use in Discussions Raises Authenticity Concerns
By
–
Please refrain from using LLMs in my threads. The cringy artifical sycophancy is almost as bad as the cheerful misrepresentation of the original idea.
-
Synthetic Data Generation for AI Model Training and Benchmarks
By
–
oh i mean it’s probably synthetic data that was generated to convey skills useful for certain benchmarks. not trying to imply that they’re training on the benchmarks. saw no evidence of that and i doubt it
-
Model Selection Confusion: Understanding AI Model Differences
By
–
But most users don't really understand what a model is, let alone how to pick the right one for their purposes Not helped by the fact that 4o and o4 are entirely different, I've seen so many people confused by that
-
OpenAI Model Early Access: Honest Review and Performance Analysis
By
–
I was not paid by OpenAI. I was just given access to the model in advance to try it out and share my honest thoughts. Read my full review (find it in my feed). you’ll see that I’m not 100% happy with the model. But it is really great at some things!
-

China’s Qwen3 Outpaces GPT-5 with 1M Token Context
By
–
While the discussion continues about whether GPT-5 meets expectations and also (as said in the Reddit AMA by Sam Altman) whether 256k context is enough or not – China enables up to 1m token context with their Qwen3 30b. China is delivering every day.
-

400K Context Window: Major LLM Capability Expansion
By
–
What's this? From the playground its 400k 400,000 context window
-

Reasoners Emerge as Pre-Training Scaling Returns Diminish
By
–
Traditional pre-training had diminishing returns (which is what the “scaling law”predicted anyway) The fact that reasoners were developed at exactly the moment where pre-training faltered is exactly the pattern of how Moore’s Law works: new technique appear to maintain the trend
-
OpenAI doubles GPT-5 rate limits for ChatGPT Plus users
By
–
GPT-5 rollout updates: *We are going to double GPT-5 rate limits for ChatGPT Plus users as we finish rollout. *We will let Plus users choose to continue to use 4o. We will watch usage as we think about how long to offer legacy models for. *GPT-5 will seem smarter starting
-
Extracting Training Data Directly from Large Language Models
By
–
FUTURE WORK – direct extraction we're working on directly extracting training data from models using RL and other methods. we'll be presenting our first work on this in COLM, and expect more in this space we may be able to directly extract data from the 120b model.. one day