Moondream 3 doesn't work on Apple MPS out of the box but a a couple of tweaks can make it work.

1. use float16 on MPS
2. disable flex decoding on MPS (and CPU fallback)

You can also make it work on the CPU, but that option is really bad. It is about 20x slower than MPS. https://t.co/GbdBWMEnVX

— Satya Mallick (@LearnOpenCV) 28 mars 2026

Moondream 3 doesn't work on Apple MPS out of the box but a a couple of tweaks can make it work. 1. use float16 on MPS
2. disable flex decoding on MPS (and CPU fallback) You can also make it work on the CPU, but that option is really bad. It is about 20x slower than MPS.

→ View original post on X — @learnopencv