The decisions you need to make… – how much context you provide
– where/what/how you summarize
– how you break up knowledge
– etc. …are a constant balance of context length, model speed and cost, use case, latency, keeping up w latest tools, and more.

→ View original post on X — @yoheinakajima,