not really, on a local network-1 gigabit, not even a 10 gigabit one-any latency is negligible in the context of llms related:

→ View original post on X — @theahmadosman