1/ System 2 Attention – leverages the reasoning capabilities of LLMs to decide what to attend to; it regenerates input context to only include relevant portions before attending to the regenerated context to elicit the final response from the model.
System 2 Attention: LLM Reasoning for Selective Context Processing
By
–
