extracting entire copyrighted books from production LLMs Researchers extracted near-verbatim copies of Harry Potter & 1984 from Claude 3.7 Sonnet using just a simple two-phase continue loop. Gemini 2.5 Pro & Grok 3 didn't even need jailbreaking, they complied directly
@askalphaxiv
-
Epiplexity: Measuring Learnable Structure for Bounded Intelligence
By
–
Now Trending on alphaXiv From Entropy to Epiplexity: Rethinking Information for Computationally Bounded Intelligence This paper introduces epiplexity, a way to measure how much learnable & reusable structure a computationally limited model can extract from data This
-
Visual Tokenizers Enhanced: Semantic Objectives Beyond VAE Pixel-Level Accuracy
By
–
VAE-only visual tokenizers has hit a wall for diffusion, as better pixel-level accuracy does NOT lead to higher-quality generation To be truly effective, this MiniMax paper adds semantic objectives via CLIP + self-supervision during tokenizer pretraining, having the latent space
-
Spurious Rewards Testing Implementation on Qwen-2.5 1.5B
By
–
We provide an implementation to test spurious rewards out on Qwen-2.5 1.5B. Check it out here!
-
Qwen excels at RL finetuning with random rewards
By
–
Qwen is hands-down the best model for RL finetuning Turns out you can even tune it with random rewards and it *still* improves. Paper shows it's not magic, pre-trained code reasoning patterns are uncovered with RLVR We provide hassle-free bash scripts to reproduce this below!
-
Alibaba’s Learnable RL Policy for LLM Context Management
By
–
This new paper from Alibaba Group makes context management into a learnable RL policy So the agent is capable of deciding when to store, update, or delete long-term info and when to retrieve, summarize, and filter short-term context bringing a fresh new way to tackle LLMs used
-
Imaginary RoPE Implementation Explored for Language Models
By
–
Check out the imaginary RoPE implementation here!
-
RoPE++ Improves Long-Range Dependencies in Language Models
By
–
The "imaginary" part of RoPE contains valuable information for long-range dependencies RoPE++ reintroduces it in heads with slower decay curves that better capture distant tokens We provide implementations with one-command scripts for both the original codebase and Nanochat!
-
NVIDIA’s Alpamayo-R1: Open Weights 4D Understanding Autopilot Model
By
–
As NVIDIA pushed its first ever open weights autopilot model alpamayo-R1 A key frontier is native 4D understanding: not just “describe the video” but reason about depth + motion + 3D interactions over time, even for a specific region. This paper introduces 4D-RGPT (also from
-
Evaluating LLM Legal Reasoning with LEXam Benchmark
By
–
How good are LLMs at legal reasoning? This Friday, join us for our AI for Law session led by @joelniklaus on LEXam — a new benchmark using real law school exams to evaluate long-form, structured legal reasoning. Link to register below