I now believe ChatGPT uses a simple sliding window with a context window of 8192 tokens:

→ View original post on X — @goodside