AI Dynamics

Global AI News Aggregator

About

PyTorch GPU Utilization Issues: Profiling Forward Backward Pass

alright y'all. still having GPU utilization issues and against my better judgement i broke out the PyTorch profiler. posting a few screenshots. doesn't seem like I/O is an issue (no gaps) how is GPU util so bad (~30%) if either forward or backward is running almost always?

→ View original post on X — @jxmnop