AI Dynamics

Global AI News Aggregator

About

safetensors v0.8.0 loads directly to Metal on Apple Silicon

Timely development: On Apple Silicon, safetensors v0.8.0 now loads directly to Metal. Tensors are loaded directly into an MTLBuffer and passed to frameworks that support it (i.e. @pytorch) via DLPack, avoiding unnecessary copies.

→ View original post on X — @julien_c