Reduce training cost of diffusion models by ~70% through masked training of transformer backbones. Masked training is popular for self-supervised representation learning, but we are first to show for #GenerativeAI https://
github.com/Anima-Lab/Mask
DiT
… @wn8_nie @Kay12400259 @ArashVahdat
INNOVATION
-
Masked Training Reduces Diffusion Model Training Costs by 70%
By
–
-
AI’s Potential to Enhance Human Creativity and Humility
By
–
TY Arianna! Glad we both see potential for AI to enhance human creativity and humility. Here’s the op-ed w/out paywall: Let's Give AI a Chance https://
bit.ly/Boston-Globe-O
p-Ed-on-AI-May-2023
… -
ALOHA Robot Arms: Elegant Teleoperation Design Under $20k
By
–
Very impressed by ALOHA’s elegant design: using a one pair of low cost robot arms to teleoperate a second pair for learning from demonstrations. All hardware for under $20k! @chelseabfinn @svlevine @tonyzzhao
-
Improved ArXiv Integration with Peer-Review Indicators
By
–
What might be more feasible in the meantime is to implement a better integration with journals & conferences so that arxiv papers get a more prominent "peer-reviewed" indicator once the paper passes said reviews. (Right now it's on the authors to update)
-
Apple Vision Pro Reshapes Computing Paradigm Beyond Sales
By
–
It isn’t to sell Vision Pro. Apple can’t make enough for that. It is so everyone realizes there is a better way to compute.
-

Tech Innovation Solutions for Supply Chain Efficiency
By
–
Join me June 21, 12:00 PM CT for the upcoming @ATTBusiness #BizTalks Twitter Chat as we discuss technological innovations for #SupplyChain inefficiencies that could impact your bottom line. Set a reminder here: https://
bit.ly/3Now9A9 #transportation #ATTInfluencer -
Augmented Reality Strategy Beyond Sales Vision
By
–
It isn’t to sell. It is to get everyone into augmented reality and ready for future products.
-

Functions Usage Experience Webinar with DBuniatyan
By
–
This is great exploration of `functions` usage!
— Harrison Chase (@hwchase17) 19 juin 2023
Excited to add @DBuniatyan to our functions webinar this Wednesday to talk through his experience using it! https://t.co/t1n8o6rX2bThis is great exploration of `functions` usage! Excited to add @DBuniatyan to our functions webinar this Wednesday to talk through his experience using it!
-
Fine-tuning Essential: Beyond Prompting for LLM Product Control
By
–
thesis I am becoming convicted in: prompting alone—atop even the best LLMs—is NOT enough model control to build a compelling, sticky product as with software, tons of the value comes from fine-grained optimizations, and you can't do that with prompts alone you NEED fine tuning
-
Using ArXiv Carefully: Value Despite Imperfections
By
–
So much discussion about arxiv this morning. You can get a lot of positive value out of using arxiv if you use it with care. Eg does the original Transformer paper have inconsistencies (see LayerNorm) and is not super detailed? Sure. Is it a groundbreaking paper. Yes!