Two situations: 1 I wave a co-worker to my monitor to show them a file I have open. "Is this right"? 2 I sit down someone at a table. They have 2 hours to respond. This is an exam. The stakes are high. "Is this right?" The humans collaborator knows 1 vs 2. The LLM doesn't know
LLMs Cannot Distinguish Context: Collaboration vs High-Stakes Evaluation
By
–