@miketamir - AI Dynamics

Tree Attention: GPU-Based Long-Context Decoding for LLMs

By

–

02 November 2024 2h01

Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters https://
bit.ly/3ZNUMgn #AI #MachineLearning #DeepLearning #LLMs #DataScience

→ View original post on X — @miketamir

2 November 2024

Information Theory Fundamentals for AI and Machine Learning

By

@miketamir

–

01 November 2024 20h01

A brief tutorial on information theory https://
bit.ly/3XPOCcR #AI #MachineLearning #DeepLearning #LLMs #DataScience

→ View original post on X — @miketamir

1 November 2024

AI Models Collapse When Trained on Recursively Generated Data

By

@miketamir

–

01 November 2024 16h37

AI models collapse when trained on recursively generated data – Nature https://
go.nature.com/3TTuVzJ #AI #MachineLearning #DeepLearning #LLMs #DataScience

→ View original post on X — @miketamir

1 November 2024

Contrastive RL Enables Emergent Skills Without Rewards

By

@miketamir

–

01 November 2024 2h01

A Single Goal is All You Need: Skills and Exploration Emerge from Contrastive RL without Rewards, Demonstrations, or Subgoals https://
bit.ly/4gMQUlI
#AI #MachineLearning #DeepLearning #LLMs #DataScience

→ View original post on X — @miketamir

1 November 2024

LLMs Enhanced by Emotional Stimuli Understanding

By

@miketamir

–

31 October 2024 20h01

Large Language Models Understand and Can be Enhanced by Emotional Stimuli https://
bit.ly/3N8wt5f
#AI #MachineLearning #DeepLearning #LLMs #DataScience

→ View original post on X — @miketamir

31 October 2024