@_seemethere can answer a few of your questions, especially around analysis of usage.
pytorch pip packages don't need the cudatoolkit, and we've been working with NVIDIA (thanks to @ptrblck_de
) to have cublas, cudnn etc. available via pip as well.

→ View original post on X — @soumithchintala