This was a fun weekend project! Generate edge cases with a pretty simple algorithm: 1. Generate two questions that are asking the same thing but worded differently
2. Run those questions through the LLM application
3. Compare the answers – if different, you know one is wrong
Testing LLM Consistency with Edge Case Generation
By
–
