Has anyone tried RL to rewrite prompts for reasoning models to further improve outputs? I'm assuming so, it feels pretty obvious, but if not I want to try it. If you know of any existing work here, pls lmk so I don't re-do something people have already done!
RESEARCH
-

Understanding Parahuman AI Responses and Capabilities
By
–
See, for example, what we call “parahuman” responses.
-
Beyond Compute: Alternative Methods for AI Improvements
By
–
What I’d like to know is how it was done other than by throwing more compute at it. Because the latter is not very interesting.
-

AI Should Augment Human Thinking, Not Replace It
By
–
AI can, and should, augment our thinking, not merely match and replace it.
-

MathArena: Evaluating LLMs on Uncontaminated Math Competitions
By
–
MathArena: Evaluating LLMs on Uncontaminated Math Competitions Balunović et al.: https://
arxiv.org/abs/2505.23281 #ArtificialIntelligence #DeepLearning #MachineLearning -
Attention Mechanisms and Core Deep Learning Components Explained
By
–
Attention is all you need. Oh, and also MLPs, layer norm, resnets, positional encoding, tokenization, Adam, fine-tuning, GPUs, etc.
-
Context Engineering Survey: Optimizing LLM Information Systems
By
–
8. A Survey of Context Engineering for LLMs This survey defines Context Engineering as a formal discipline for optimizing information given to LLMs, outlining its core components, retrieval, processing, and management, and their integration in systems like RAG, memory, and
-
Q-Chunking: Reinforcement Learning for Long-Horizon Sparse-Reward Tasks
By
–
9. Q-Chunking Q-chunking is a reinforcement learning approach that uses action chunking to improve offline-to-online learning in long-horizon, sparse-reward tasks.
-
LLMs in AIOps: Survey of 183 Papers and Methods
By
–
10. A Survey of AIOps This survey analyzes 183 papers to evaluate how LLMs are being used in AIOps, focusing on data sources, task evolution, applied methods, and evaluation practices.
-
Scaling Reinforcement Learning for Enhanced Reasoning in Small Models
By
–
6. Scaling up RL This paper investigates how prolonged RL can enhance reasoning abilities in small language models across diverse domains.