Running Mixtral8x7b on an RTX 3070. Sadly pretty slow, about 2,55 Tokens /s. Need better GPU :/

→ View original post on X — @kimmonismus