Special tokens like these are used to delimit things like "this section is the user asking a question" vs "this section is an answer from the LLM" – or sometimes for things like "this is the output of a separate tool" I have no idea what those gh ones are for!

→ View original post on X — @simonw,