Most companies only have very crude understanding of token usage right now, so they veer from focusing on adoption (“everyone should use as many tokens as possible”) to cost control (“can we just use local models?”) depending on the moment and manager. This is all very new.
Companies wrestling with token usage and model choices
By
–