5090 has 32GB of VRAM, 4x 3090s have 96GB of VRAM when it comes to LLMs inference, we care more about memory as models are better fully offloaded into VRAM than being shared across system RAM and a single RTX 5090's VRAM
RTX 5090 vs 4x 3090s VRAM comparison for LLM inference
By
–
Leave a Reply