AI Dynamics

Global AI News Aggregator

About

Evaluating LLM reasoning on graph-based natural language tasks

Each question asks the LLM to compute the outcome of a natural language question (operator) over graphs encoded via node + edge lists. Example: “Find the minimum-density subgraph…” Because these questions all come with verifiable answers, LLM responses are easy to evaluate.

→ View original post on X — @snorkelai