torch.compile is cool but LLM compile: takes your .py repo as string and outputs a brand new, custom, from scratch, minimal code repository directly running your network in highly optimized CUDA
LLM Compile: Converting Python Repositories into Optimized CUDA Code
By
–
Leave a Reply