Interesting, have you tried the streaming mode in datasets? It allows you to stream a row/ batch at a time. If yes, then what would you like us to add to that.

→ View original post on X — @reach_vb