okay maybe the question is – how would one take “extra care”? the D is the D, cant be touched. and yet people are constrained decoding thousands of tokens with presumably only slight intelligence drop. maybe my json example is too light of a constraint. the OODness would
Taking Extra Care with Model Decoding and Out-of-Distribution Constraints
By
–
Leave a Reply