it really is incredible what kinds of things become possible when RL on LLMs works. clearly we’re just getting started
LLMS
-

DeepSeek’s nano-vllm: lightweight Python vLLM implementation
By
–
DeepSeek engineer Xingkai Yu just dropped nano-vllm — a lightweight vLLM reimplementation from scratch. It's a clean implementation under 1,200 lines of Python code with comparable inference speeds to vLLM. Perfect for learning or building lean! Project:
-
Hypernetworks Applied to Modern Large Language Models
By
–
Happy to see Hypernetworks applied to modern LLMs
-

Try Qwen3 on Cerebras: AI Model Inference Platform
By
–
Think. But don't over think.
Try saying 'hello' to Qwen3 on Cerebras: https://
inference.cerebras.ai/?utm_source=tw
itter
… -
Prefix Tuning Approaches: Layer-wise Activation Prepending Comparison
By
–
My understanding is that @percyliang
's prefix tuning approach prepended activations to *every* layer, but yours only prepends to the first layer — is that right? -
Prefix Tuning Initialization with Real Tokens and DoRA
By
–
Is the trick of initializing with real tokens the secret to making all prefix tuning approaches competitive? BTW @EyubogluSabri I don't see DoRA mentioned in your paper – I wonder if that would close the gap a bit?
-
LoRA vs DoRA vs Prefix Tuning: Fine-tuning Method Effectiveness
By
–
The big open question for me is why LoRA (and particularly DoRA) has been the most successful for fine-tuning, but it worked so badly for this use case. Or maybe the opposite – why did prefix tuning work so well?
-

Claude Limited by Context Window in Research Tasks
By
–
Claude not able to continue my research chat about context compression papers because it ran out of context because it doesn't use context compression.
-

KerasHub: 70+ Pretrained Models Supporting JAX, TF, PyTorch
By
–
KerasHub is a collection of over 70 popular pretrained model architectures — LLMs, VLMs, image generation models, etc — that work with JAX, TF, PyTorch. They all support HuggingFace checkpoints — you can load any HF model with them for the corresponding architecture.
-
Hundreds of AI Model Checkpoints from Scaling Research
By
–
I now realized I probably have dozens of models there (maybe a hundred?) due to a dump of many checkpoints from one scaling paper, plus ul2 and flan-t5/ule series. And also umt5.
