Making everything one big CUDA graph helped wall clock consistency a lot on a laptop, but we still fought with power management. Looking forward to using an Nvidia Spark in the future. It isn’t in the repo code, but the single biggest win I have seen is an “action input” model
CUDA graphs and action input models improve performance consistency
By
–