BTW I mentioned the GCHQ Connections eval idea to @BorisMPower quite a while ago, and I think he was planning to check it out.
@jeremyphoward
-
O3 AI Model Achieves Impressive Progress Milestone
By
–
(None of that is to detract from how impressive it is that O3 has gotten as far as it has.)
-
AI struggles with harder versions of the game task
By
–
Oh yes I know! Just saying that that's by far the easiest version; and often it can't figure out the final category description (which isn't part of the evals AFAICT). It makes no progress on the other 2 versions of the game that I mentioned.
-
Semantic Understanding in AI Evaluation Metrics
By
–
Our family rules are that it only counts as "solved" if you figure out the final category descriptor correctly (i.e semantically close, not identical wording). NYT's Connections Bot mentions the same thing sometimes. I don't think the current evals check this AFAIK.
-
FastHTML Sample App in 84 Lines of Code
By
–
BTW the whole fasthtml sample app is just 84 lines of code. Here's a version without the comments if you just want to read the code itself:
-
JEPA as LLM Plus: Implementation Challenges Explained
By
–
You could argue that JEPA is just LLM+tinything. Although getting tinything to actually work right is pretty hard.
-
Yann’s ASI Theory Beyond LLM Integration Strategy
By
–
Yann doesn't have a prior. He has a theory based on years of study. His theory doesn't need to change based on 01. He hasn't claimed llm will at least partially be part of asi. But since lots of other folks are already working on that bit, his best use of time is on other bits.
-
OAuth Implementation: Less Than 10 Lines of Code
By
–
If you'd like to use oauth, then that's <10 lines of code to add…
-
Complete FastHTML App with Login, CRUD, Drag-Drop Features
By
–
Did you know we have a complete, heavily commented, updated idiomatic FastHTML app that shows how to create a login system, drag/drop, all CRUD endpoints, etc in a single small Python app? Read it yourself, or give it to your LLM as context.