First ever activation function swapping strategy just dropped for LLMs! Meta’s new Stochastic Activation proposes a new method which randomly selects between non-linear functions (ReLU & SiLU) in the FFN of LLM, achieving an activation sparsity of 90% with 1.65x CPU speedups!
RESEARCH
-
Engaging podcast moments on AI topics discussed
By
–
awkwardly worded. ~31:00 – 32:47 are two of the coolest minutes of a podcast I've ever heard. there we go.
-

Geoffrey Hinton Announces AI Safety Lectures by Owain Evans Toronto
By
–
Some generous companies in Toronto are funding three lectures on AI safety by Owain Evans on Nov 10, 11, 12. Tickets are $10 and are available at thehintonlectures.rsvpify.co…
→ View original post on X — @geoffreyhinton, 2025-10-10 17:16 UTC
-
The Excitement of Checking AI Experiment Results Overnight
By
–
waking up and feeling excited to check your experiment jobs from last night is what peak ai researcher lifestyle looks like.
-
AI practical examples and real-world applications
By
–
Re: ai, I have yet to see that be the case. Any good examples?
-
Social Responsibility in Computer Science and Modern AI Challenges
By
–
Today at 3 pm PT! Join us for a conversation with Lancaster University’s Lucy Suchman and Stanford’s Terry Winograd. They will examine the history of social responsibility in the computer science field and discuss the challenges posed by today’s AI.
-
TRM motivation and specialized model design considerations
By
–
Thanks for sharing. Points a 1 and 2 are actually what motivated the work on TRM as mentioned in the paper. I think point 3 makes sense as this is a small, specialized model, not a large generalist model.
Point number 4 also makes sense, this has always been true for ML and DL. -
MeitY Pavilion Wins Best Exhibitor at India Mobile Congress 2025
By
–
The MeitY Pavilion has been awarded Best Exhibitor – Government at the India Mobile Congress 2025, recognizing its engaging showcase of India’s AI journey and the upcoming AI Impact Summit 2026. The Pavilion spotlighted IndiaAI’s efforts to build an inclusive, safe, and
