Can LLMs achieve massive capacity gains without massive increases in computational cost? YES, say researchers from Shanghai Jiao Tong University and Xiaohongshu! They introduce JTok, a novel scaling method that uses lightweight "token-indexed parameters" to intelligently
JTok: Scaling LLMs with Token-Indexed Parameters
By
–
