Yeh! Would deffo recommend contrastive search. It works quite well (however, over generates sometime ) Greedy search simply results in lost context.
Contrastive Search vs Greedy Search for LLM Generation
By
–
By
–
Yeh! Would deffo recommend contrastive search. It works quite well (however, over generates sometime ) Greedy search simply results in lost context.