It’s a balance of figuring out how much past context you want to pull in. If you pull zero, it stays within limit easily but no prev context. If you pull 5, you get decent context but it can get large. So then you can consider adding a summary step. pic.twitter.com/1jN3J8DMQI

— Yohei (@yoheinakajima) 3 avril 2023

It’s a balance of figuring out how much past context you want to pull in. If you pull zero, it stays within limit easily but no prev context. If you pull 5, you get decent context but it can get large. So then you can consider adding a summary step.

→ View original post on X — @yoheinakajima,