FWIW I wasn’t able to reproduce, using http://
labs.perplexity.ai with codellama-70b-instruct. I guess it depends on some detail of system prompt / format. I got 10/10 success using both prompts from the replies here and my own.
Codellama-70b-instruct success rate, prompt variations
By
–
