i was looking this up and there's actually some discussion on eventually integrating this: http://
github.com/huggingface/da
tasets/issues/2252
… i think there are some complicated issues that make the threading hard to merge for the general case, not sure exactly why so i just post code here instead 🙂

→ View original post on X — @jxmnop