there's a llm that rewords things into 256 if it's longer than 256, i think it puts it back in your prompt bar so you can see it, in our experience usually there's just a lot of filler words in long prompts and you can just remove them and everything works fine
LLM Prompt Compression: Removing Filler Words Improves Efficiency
By
–
Leave a Reply