AI Dynamics

Global AI News Aggregator

About

Prompt Optimization: Context Size Impact on Model Performance

Depends how many examples you have. If say, 500 or less, include the task description in the prompt so the model picks it up quicker. If you’re in the thousands, no context often leads to similar or better performance and slightly lower inference costs.

→ View original post on X — @mattshumer_