Agreed on both. Latency depends mostly on the agent blocks, not the connections themselves (those are basically free). With a decent local model the bottleneck is inference time per agent call, so the router and manager agents dominate. Most of the 29 edges are just data
Agent Latency Optimization: Router and Manager Bottlenecks
By
–
Leave a Reply