its unclear to me even for code because compile-time and startup costs (even for a CUDA/CuDNN loading Python program) is 1 second.
If you strip out the binary blobs that need to load (say business logic filled program), then its quicker, but i'm not sure if there aren't other

→ View original post on X — @soumithchintala,