In an nbdev project, the .ipynb files are the source. The .py files state at the top the source file to look at.
CODE
-
Token Sampling by Average Frequency with Single Token Prompting
By
–
i sample tokens based on average frequency and prompt with 1 token
-
Synthetic Data Generation for AI Model Training and Benchmarks
By
–
oh i mean it’s probably synthetic data that was generated to convey skills useful for certain benchmarks. not trying to imply that they’re training on the benchmarks. saw no evidence of that and i doubt it
-
Coding AIs That Fix Bugs Instead of Creating Them
By
–
Imagine coding AIs that fix bugs instead of causing more.
-
Deduplicating Redundant AI-Generated Output Data
By
–
FUTURE WORK – deduplication even though i varied the random seed and used temperature, a lot of the outputs are highly redundant it would be prudent to deduplicate, i bet there are only 100k or fewer mostly-unique examples here
-
Describing Text Distribution Differences Between Language Models
By
–
FUTURE WORK – describing differences @ZhongRuiqi has some incredible work on methods for describing the difference between two text distributions *in natural language* we could compare outputs of 20b to the 120b model, or LLAMA, or GPT-5…
-
Embedded Generations: AI Model Capabilities in Math and Code
By
–
here's a map of the embedded generations the model loves math and code. i prompt with nothing and yet it always reasons. it just talks about math and code, and mostly in English math – probability, ML, PDEs, topology, diffeq
code – agentic software, competitive programming, -
GPT-OSS Training Data Analysis: Bizarre Results Revealed
By
–
curious about the training data of OpenAI's new gpt-oss models? i was too. so i generated 10M examples from gpt-oss-20b, ran some analysis, and the results were… pretty bizarre time for a deep dive