alright y'all. still having GPU utilization issues and against my better judgement i broke out the PyTorch profiler. posting a few screenshots. doesn't seem like I/O is an issue (no gaps) how is GPU util so bad (~30%) if either forward or backward is running almost always?
PyTorch GPU Utilization Issues: Profiling Forward Backward Pass
By
–
