i’m sure there are some good ones, but iOS benefits from unified memory pools
HARDWARE
-
WordPress categories for AI topics
By
–
The numbers are from ARC Prize, in the quoted post (two quotes down)
-
Running 8B Q4 Model on iPhone 15 Pro RAM
By
–
decent results with 8b q4 on a 15 Pro, might be able to squeeze it into a 14 if you’re willing to use most of the phone ram
-
iOS Hardware Limitations for FP16 Model Execution
By
–
this is at q4, don't think it could run fp16 due to iOS limits
-
Low Resolution Screens Larger Than Gameboy Pixels
By
–
oh you mean on the screens that have fewer pixels than a gameboy but are somehow still larger?
-
Small reasoning models improving offline phone AI capabilities
By
–
one of the best you can do offline on a phone for now, but small reasoning models are going to be much better
-
Ministral 8B Running Offline on Mobile at 10 Tokens/Second
By
–
Here’s Ministral 8B running at 10 tok/s on a phone.
— Aaron Ng (@localghost) 31 décembre 2024
Siri isn’t going to save you when you’re stuck without internet. An offline backup AI is essential. pic.twitter.com/nKmjb1Z5jGHere’s Ministral 8B running at 10 tok/s on a phone. Siri isn’t going to save you when you’re stuck without internet. An offline backup AI is essential.
-
V100 GPUs Originally Designed for Molecular Dynamics Simulations
By
–
I am old enough to remember that V100 were actually designed with MD simulations in mind (or maybe it was their predecessor?) due to their fp64 support
-
Use Cases for Higher Precision Computing: Debugging, Education, Simulations
By
–
Debugging, educational use cases, maybe simulations you run in higher precisions (like MD and physics simulations)