L3.1 405B at least anecdotally requires a 3×8 setup if you include redundancy (1×8 if not) which is not cheap either and I think for now most will opt for price per mil.
L3.1 405B GPU Requirements and Cost-Benefit Analysis
By
–
Global AI News Aggregator
By
–
L3.1 405B at least anecdotally requires a 3×8 setup if you include redundancy (1×8 if not) which is not cheap either and I think for now most will opt for price per mil.
Leave a Reply