Here’s Ministral 8B running at 10 tok/s on a phone.

Siri isn’t going to save you when you’re stuck without internet. An offline backup AI is essential. pic.twitter.com/nKmjb1Z5jG

— Aaron Ng (@localghost) 31 décembre 2024

Here’s Ministral 8B running at 10 tok/s on a phone. Siri isn’t going to save you when you’re stuck without internet. An offline backup AI is essential.

→ View original post on X — @localghost,