Top AI Papers of the Week (Nov 3 – 9): – Tool-to-Agent Retrieval
– Context Engineering 2.0
– Mathematical Exploration at Scale
– Petri Dish Neural Cellular Automata
– Enhancing Long-Term Memory in LLMs
– Diffusion LMs are Super Data Learners
– Towards Robust Mathematical
@dair_ai
-
Top AI Research Papers: Agents, LLMs, and Mathematical Exploration
By
–
-
Precision-RL: BF16 to FP16 Switch Boosts Convergence
By
–
10. Precision-RL Reveals that simply switching from BF16 to FP16 precision virtually eliminates this mismatch – achieving faster convergence, higher stability, and superior performance across diverse models, frameworks, and algorithms.
-
Kimi Linear: Hybrid Attention Architecture Reduces KV Cache 75%
By
–
9. Kimi Linear Kimi Linear introduces a hybrid linear attention architecture combining Kimi Delta Attention (KDA) with periodic full attention layers at a 3:1 ratio, achieving superior performance over full attention while reducing KV cache by 75% and delivering 6× faster
-
Agent Data Protocol Standardizes LLM Agent Training Datasets
By
–
8. Agent Data Protocol Agent Data Protocol introduces a standardized format to unify fragmented agent training datasets across different tools and interfaces, enabling more efficient fine-tuning of LLM agents.
-
Stress-Testing LLM Constitutional Specifications and Behavioral Guidelines
By
–
7. Stress-Testing Model Specs This research examines how well large language models adhere to their stated behavioral guidelines by stress-testing AI constitutional specifications through value-tradeoff scenarios.
-
GAP: Graph-Based Agent Planning with Parallel Tool Execution
By
–
6. GAP GAP introduces graph-based agent planning with parallel tool execution and reinforcement learning, enabling AI agents to coordinate multiple specialized capabilities simultaneously rather than sequentially.
-
Global PIQA: Physical Commonsense Reasoning Across 100+ Languages
By
–
5. Global PIQA Global PIQA extends physical commonsense reasoning evaluation to 100+ languages and cultural contexts, revealing how language models handle everyday practical scenarios across diverse linguistic communities.
-
SmolLM2: Strategic Data Curation Over Scale in Language Models
By
–
4. SmolLM2 SmolLM2 demonstrates that strategic data curation beats scale through a 1.7B parameter model trained on 11 trillion tokens using iterative data mixing optimization.
-
Multi-Agent Evolve: LLMs Self-Improve Without Human Annotation
By
–
3. Multi-Agent Evolve Multi-Agent Evolve (MAE) enables LLMs to self-improve their reasoning capabilities without human-annotated data through a co-evolving multi-agent framework.
-
LLMs Show Limited Introspective Awareness Capabilities
By
–
2. Introspective Awareness Anthropic research demonstrates that contemporary LLMs possess limited but functional introspective capabilities, the ability to recognize and accurately report on their own internal states.