To follow up, I had a chance to try it btw:
before: 212ms / iter
>>> model = torch.compile(model)
after: 135ms / iter
nice 🙂
PyTorch Compile Optimization Reduces Iteration Time by 36%
By
–
Global AI News Aggregator
By
–
To follow up, I had a chance to try it btw:
before: 212ms / iter
>>> model = torch.compile(model)
after: 135ms / iter
nice 🙂
Leave a Reply