Curious if the constant-time recall actually holds up on 100k+ context, haven't had the chance to test it out yet.
Testing Constant-Time Recall Performance on 100k+ Context Windows
By
–
By
–
Curious if the constant-time recall actually holds up on 100k+ context, haven't had the chance to test it out yet.