Let me introduce you to ODS, one click install that runs on Linux, Mac, and Windows Once you install ODS, it 1) detects your hardware, 2) downloads the best model for your hardware, and 3) starts local inference and gives you an agent to use It works on any hardware and sets
