Check out the imaginary RoPE implementation here!
MACHINE LEARNING
-
RoPE++ Improves Long-Range Dependencies in Language Models
By
–
The "imaginary" part of RoPE contains valuable information for long-range dependencies RoPE++ reintroduces it in heads with slower decay curves that better capture distant tokens We provide implementations with one-command scripts for both the original codebase and Nanochat!
-
AI Scientist: Game Changer Tool for Research Automation
By
–
ok this is going to be game changer for me the "AI Scientist"
-
Write High-Performance Hardware Kernels in Python with Pallas
By
–
You no longer need to leave Python to write high-performance hardware kernels. Learn how to use Pallas in Keras to author custom ops that lower to Mosaic for TPUs or Triton for GPUs:
-
End-to-End Test-Time Training Eliminates KV Cache Limitations
By
–
Farewell to the shackles of KV Cache, compressing long contexts into weights—is there hope for continuously learning large models? Researchers from Stanford, NVIDIA, UC Berkeley, and the Astera Institute present a new method called End-to-End Test-Time Training (TTT-E2E). They
-
NVIDIA’s Alpamayo-R1: Open Weights 4D Understanding Autopilot Model
By
–
As NVIDIA pushed its first ever open weights autopilot model alpamayo-R1 A key frontier is native 4D understanding: not just “describe the video” but reason about depth + motion + 3D interactions over time, even for a specific region. This paper introduces 4D-RGPT (also from
-
AI Glasses Provide Real-Time On-the-Job Training
By
–
AI Glasses teach in real time. While doing the job.
-
Context Breakdown: The Hidden Challenge in AI System Reliability
By
–
Most AI systems don’t fail because of bad prompts.
They fail because context breaks at scale. If you’re building AI agents, LLM workflows, copilots, or automation, this is the layer that quietly decides whether your system is reliable or unpredictable. We’re hosting a 5-hour, -
Multimodal Sleep Foundation Model for Disease Prediction
By
–
A multimodal sleep foundation model for disease prediction – Nature Medicine https://
buff.ly/W0r4qKh
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
FysicsWorld: First Unified Multimodal AI Benchmark
By
–
With only one test, you could measure an AI's true mastery of sight, sound, and language together! But how? Fudan University & Fysics AI present FysicsWorld, the first full-modality benchmark. It's a unified test that pushes models to understand, generate, and reason across