you can add system message manually in each row of the csv. if you use a format like https://
huggingface.co/datasets/Huggi
ngFaceH4/no_robots
…, you can set apply_chat_template to True to make it automatically. however, many models dont support this.
Adding System Messages to CSV Rows for Model Training
By
–