you're literally an AI chatbot
@jxmnop
-
Bringing long-horizon agentic workflows to everyone
By
–
bringing long-horizon agentic workflows to the masses
-
Scaling compute on context to study Moby Dick and Fed livestreams
By
–
Joe you might not want to hear this but as we speak I'm scaling compute on your context. the model is studying Moby Dick, it's developing new theories of orality, it's watching Fed livestreams.
-
Fun data analysis, generalization, and fixing a model hallucination
By
–
it's been fun digging into data together! and seeing fun examples of generalization from weights except that one time our model hallucinated that Sabri has a dog named Pearl. good thing we fixed that
-
Impressed by depth of model building; many fixes improve initial model
By
–
also in general i've been really impressed with the amount of DEPTH there is to building models in industry, and working on larger projects over longer timespans honestly the first model we trained was not very smart. a few clever ideas and so many little fixes/improvements
-
Automating post-training with continual learning and OPSD-RL interpolation
By
–
on a technical level it feels like we're automating post-training we want to take a bunch of data and output a post-trained model – then iterate this process many times. continual learning by induction the ideal algorithm is an interpolation of OPSD and RL with a lot of
-
Leaving Their PhD to Co-Found Engram
By
–
Finally I share what I have devoted myself to! I left my PhD at the end of 2025 and co-founded Engram. There are a few startups in SF right now making very different bets on the right way to train AI models. Here is ours: people want models that
-
Writing Threatened by AI: A Sense of Collapse
By
–
The situation with writing right now is really bad! You can almost feel the collapse of the mode. Everyone writes with AI all the time. And when they don't write with AI, they produce text that looks so much like AI that it's hard to make the
-
Frontier labs’ billion-dollar brute-force data annotation with diverse annotators
By
–
wish there was more public info on what's happening behind the scenes. frontier labs are spending BILLIONS paying {poets, musicians, accountants, consultants, …} to annotate massive amounts of data:
• essays
• slides
• spreadsheets
it's a brute-force bet. but seems to be