having spent a little bit of time working on agents, the bottleneck if often not inference speed but interaction speed. Interacting with buttons and browsers and UIs is so inefficient and much slower than say if you had direct API access, and very often you don't.

→ View original post on X — @soumithchintala,