Perhaps we need a system for short-term memory, one that condenses previously viewed portions of the movie into a concise, fixed-size context window. This window would be continuously updated after every frame or couple of frames, ensuring that it always contains the most vital