One way to deal with the limitations of having to download model – let user use cloud model but show an indicator Cloud Based Conversation or smth then once it's locally ran switch to 100% private local conversation
– if user GPU or connection doesn't allow for locally run

→ View original post on X — @levelsio