Congratulations @TencentHunyuan for the best image generation model in the world. It comes with a fantastic paper that describes the data pipeline in great detail. More detail on the RL part would be great
@nandodf
-
DeepSeek OCR Project Reproduction: Quality Data Requirements
By
–
Very nice project reproducing deepseek OCR. More (good quality) data needed, but great start
-
Gratitude to Soumith for AI Community Contributions
By
–
Thank you Soumith for contributing so much to our community and to the development of AI. I’m excited to see what you do next, and I also hope you take a good holiday
-
AI in Academia vs AI in the World: Different Priorities
By
–
AI in academia: create architectures and algorithms for conference papers. AI in the world: create datasets and evaluations to engineer the models people use.
-
Microsoft Recruits Data Engineers for Its AI Team
By
–
Data Engineers at MAI Monday CV > JoinAITeam@microsoft.com
-
TU Berlin’s Legacy of Success in Machine Learning
By
–
We do TU Berlin is one of the most successful schools in the history of ML, Klaus, Alex, Marc, Bernhard … you should be very proud I hope.
-
Karpathy’s exposition highly recommended for scientists and engineers
By
–
I just listened to it and wholeheartedly recommend it. @karpathy
’s exposition is very informative and aligns well with what most hands-on scientists and engineers believe. -
Prioritizing Knowledge Reduction Techniques Over Terminology
By
–
I’m more interested in reductions than what one calls it. Knowledge of reducing, eg of dagger to distillation, can be very helpful to decide what to do with a finite compute budget.
-
Congratulations to Veo and his team for outstanding achievement
By
–
Veo is really remarkable. Congratulations @avdnoord and team!
-
Formal RL Problem Definition and RLHF Practice Discussion
By
–
Thanks, @CsabaSzepesvari
. Would you mind formally defining the RL problem for everyone here (I know you can better than most). I’d love for us to start with the formal definition and address the practice of RLHF in that context. In particular in most of RLHF, the states