Bigger context is useful, but not if it keeps carrying forward noise that should have been compressed away. In some cases that extra clutter can even hurt performance relative to a stronger compaction approach that preserves only the minimum viable context needed for the task.
Context Size vs. Quality: When Less Compression Hurts Performance
By
–