We convert LLMs into chatbots by using markers, eg User and Assistant: User: What's the capital of France?
Assistant: Paris.
User: What did I just say? the "I just said" attribution works because the tokens are cleanly labeled with role markers. But strip the markers and

→ View original post on X — @nandodf,