Timely development: On Apple Silicon, safetensors v0.8.0 now loads directly to Metal. Tensors are loaded directly into an MTLBuffer and passed to frameworks that support it (i.e. @pytorch) via DLPack, avoiding unnecessary copies.
safetensors v0.8.0 loads directly to Metal on Apple Silicon
By
–
