You can fit more total RAM on the board if you use “normal” memory than high-bandwidth memory and it is super cheap. Maybe high-bandwidth memory is still the right choice, but using HBM isn’t the slam dunk many people think it is.
HBM vs Standard RAM: Cost-Benefit Analysis for AI Hardware
By
–