I definitely agree there's lots of problems at that step. I think reasoning models actually have a way around it to some extent though, because they can perform computation in language:

→ View original post on X — @honnibal