Nice paper. Very good performance by Mistral Large and Mixtral 8x22B on the new GSM1K dataset! Results from Table D (plotted in Figure below) are also a good reminder that models are very sensitive to prompt. In general, it is also good to use sampling & majority voting to

→ View original post on X — @guillaumelample