100% yes, llama.cpp uses static templates atm and doesn't have jinja support (primarily because jinja is quite bulky). Static templates work quite well tho (Except when they don't :p) cc: @ggerganov too
llama.cpp Static Templates vs Jinja Support Discussion
By
–
Leave a Reply