Ran some benchmarks on different context lengths all the way to 180k Findings below
RESEARCH
-
Ways to Train Large Language Models Effectively
By
–
Ways to Train an #LLM
by @goyalshaliniuk #GenAI #ArtificialIntelligence #MachineLearning #ML -
Exploring dense new format with tests in BF16, FP8, NVFP4 and TP scaling
By
–
it's very dense, a new format that I am playing with still need to test it in concurrency + try it in nvfp4 hopefully will be able to compare perplexity in bf16 / fp8 / nvfp4 as well as TP performance jumps from 2 -> 4 -> 8 nodes across all 3 formats most important thing
-
Does Uber Intelligence Come Before Superintelligence?
By
–
does uberintelligence come after or before superintelligence
-
Formal Game Theory vs Psychological Common Knowledge in AI
By
–
That's a bit too harsh. Here's ChatGPT's summary: Probably not a misunderstanding in the strict sense. It looks more like Pinker is using a psychological, operationalized version of common knowledge rather than insisting on the fully formal game-theoretic one. In the formal
-
AI as Autocomplete, Not True Intelligence
By
–
AI doesn’t understand your question. It predicts which words are statistically likely to follow it. That’s not intelligence. That’s autocomplete with a PhD-sized training set.
-
Testing concurrency, nvfp4, and TP performance across BF16, FP8, nvfp4
By
–
still need to test it in concurrency + try it in nvfp4 hopefully will be able to compare perplexity in bf16 / fp8 / nvfp4 as well as tp performance jumps from 2 -> 4 -> 8 nodes across all 3
-
MIT Cheetah Quadruped Robot Redefining High-Performance Legged Locomotion
By
–
MIT Cheetah: The Agile Quadruped #Robot Redefining High-Performance Legged Locomotion
— Ronald van Loon (@Ronald_vanLoon) 12 avril 2026
by @IntEngineering
#Robotics #Engineering #ArtificialIntelligence #Innovation #Technology pic.twitter.com/9A8MwVNpc2MIT Cheetah: The Agile Quadruped #Robot Redefining High-Performance Legged Locomotion
by @IntEngineering #Robotics #Engineering #ArtificialIntelligence #Innovation #Technology -
Past Light Cone Does Not Determine Future One
By
–
Hey Albert, your past light cone does not determine your future one, so God plays dice with the universe even without quantum mechanics.