What's this? From the playground its 400k 400,000 context window
GENERATIVE AI
-
Coding AIs That Fix Bugs Instead of Creating Them
By
–
Imagine coding AIs that fix bugs instead of causing more.
-
OpenAI doubles GPT-5 rate limits for ChatGPT Plus users
By
–
GPT-5 rollout updates: *We are going to double GPT-5 rate limits for ChatGPT Plus users as we finish rollout. *We will let Plus users choose to continue to use 4o. We will watch usage as we think about how long to offer legacy models for. *GPT-5 will seem smarter starting
-
Extracting Training Data Directly from Large Language Models
By
–
FUTURE WORK – direct extraction we're working on directly extracting training data from models using RL and other methods. we'll be presenting our first work on this in COLM, and expect more in this space we may be able to directly extract data from the 120b model.. one day
-
Deduplicating Redundant AI-Generated Output Data
By
–
FUTURE WORK – deduplication even though i varied the random seed and used temperature, a lot of the outputs are highly redundant it would be prudent to deduplicate, i bet there are only 100k or fewer mostly-unique examples here
-
Describing Text Distribution Differences Between Language Models
By
–
FUTURE WORK – describing differences @ZhongRuiqi has some incredible work on methods for describing the difference between two text distributions *in natural language* we could compare outputs of 20b to the 120b model, or LLAMA, or GPT-5…
-

GPT-OSS 20B Samples Dataset Released on Hugging Face
By
–
if you want to try the data, here you go, it's on huggingface: http://
huggingface.co/datasets/jxm/g
pt-oss20b-samples
… let me know what you find! -

Model Unicode Skills and Physics Limitations Explored
By
–
i also learned a lot from this one. the model is *really* good at using unicode …but might be bad at physics. what in the world is a 'superhalo function'
-

AI Models Generate Creative Screenplay Examples
By
–
there are a small number of creative outputs interspersed throughout here's one example where the model starts writing a sketch for a norwegian screenplay
-

OCR Conjecture: Evidence OpenAI Scanned Books for Training
By
–
the OCR conjecture: some examples include artifacts such as OCRV ROOT, which indicate the training data may have been reading between the lines: OpenAI is scanning books (for some reason the model loves mentioning how many deaf people live in Malaysia)
