LlamaFusion Extends pretrained text-only LLMs with multimodal capabilities while preserving language performance. Problem:
Training multimodal models from scratch is costly and risks degrading pretrained language abilities. Method:
Adds image-specific modules to pretrained
OPEN SOURCE
-
LlamaFusion Extends LLMs with Multimodal Capabilities
By
–
-
Open-Source Robots Deployed at Hugging Face Paris Inauguration
By
–
Open-source robots at the Hugging Face inauguration party a few hours ago in Paris@pollenrobotics Reachy deployed by the amazing @RemiCadene from @LeRobotHF and @NepYope pic.twitter.com/VDXvSHH9yD
— Thomas Wolf (@Thom_Wolf) 21 décembre 2024Open-source robots at the Hugging Face inauguration party a few hours ago in Paris @pollenrobotics Reachy deployed by the amazing @RemiCadene from @LeRobotHF and @NepYope
-
GitHub AI Engineering Hub Content Planner Flow Repository
By
–
Check out the incredible post by @akshay_pachaar below…
— Kirk Borne (@KirkDBorne) 21 décembre 2024
And visit the related GitHub: https://t.co/CbK5kcop3P https://t.co/6er6UfKgVJCheck out the incredible post by @akshay_pachaar below… And visit the related GitHub: https://
github.com/patchy631/ai-e
ngineering-hub/tree/main/content_planner_flow
… -
Writing PyTorch Compiler Stack Entirely in Python
By
–
i mean….we write our entire compiler (dynamo/inductor) in Python. You and I come from opposite tastes 🙂
-
Genesis Sim: Advanced Physics Simulator Powered by Taichi Framework
By
–
i rabbit-holed into the Genesis Sim codebase because the website is hypey and unclear; and I didn't want to just blindly retweet.
It's basically like Mujoco but with more advanced materials/rendering/solvers, written all in Python thanks to being powered by Taichi, which makes it x.com/zhou_xian_/sta… -
Team Release Receives Praise for Open Source Support
By
–
congrats on the release sam and team, would love to see some open source love too:
-
Genesis Sim: Advanced Physics Simulator Built with Taichi
By
–
i rabbit-holed into the Genesis Sim codebase because the website is hypey and unclear; and I didn't want to just blindly retweet.
— Soumith Chintala (@soumithchintala) 20 décembre 2024
It's basically like Mujoco but with more advanced materials/rendering/solvers, written all in Python thanks to being powered by Taichi, which makes it… https://t.co/68wEaKQbRDi rabbit-holed into the Genesis Sim codebase because the website is hypey and unclear; and I didn't want to just blindly retweet.
It's basically like Mujoco but with more advanced materials/rendering/solvers, written all in Python thanks to being powered by Taichi, which makes it -
Meta releases Video Seal model with permissive license and code
By
–
With this release we’re making the Seal model available under a permissive license, alongside a research paper, training code and inference code.
-
Redis Founder Returns to Redis Inc Leadership
By
–
I missed that @antirez (founder of Redis) moved back to @Redisinc
. That's huge…. -
Speech-to-Speech Models: Cascaded Approaches Still Outperform End-to-End
By
–
We're so early! even the current SoTA speech-to-speech models are so dumb compared to cascaded speech-to-speech (ASR + LLM + TTS) There's loads of low hanging fruits to pick still! Looking forward for open models to climb up this benchmark in 2025