We made strides in surgical #AI which involves assessing the skill of surgeons, predicting patient outcomes, and discovering novel surgeon biomarkers based on multi-modal data and deep learning algorithms. @AjhungMD gives an excellent overview here
RESEARCH
-
ZerO: Deterministic Weight Initialization with Binary Values
By
–
We developed the first fully deterministic weight initialization procedure for training any neural network. Our scheme, ZerO, initializes networks’ weights with only zeros and ones based on identity, and Hadamard transforms. ZerO achieves SOTA https://
arxiv.org/abs/2110.12661 -
Robust Vision Transformer Architecture Wins Semantic Segmentation Challenge
By
–
We also developed robust vision transformer architecture, fully attention networks (FAN), with channel-based attention for robustness. We won the Semantic Segmentation Tracking of Robust Vision Challenge at ECCV. https://
arxiv.org/abs/2210.12852 -
Neural Operators Enable Single-Step Diffusion Model Image Generation
By
–
2022 saw diffusion models for generative AI. But one downside is very slow sampling. We used neural operators to replace ODE solvers and showed that just one function evaluation is sufficient to achieve the best image generation quality. https://
arxiv.org/abs/2211.13449 -
MineDojo: Generalist AI Agents with Text Prompts in Minecraft
By
–
Decision-Making with Generalist AI Agents: We built Minedojo framework in Minecraft with text prompts for open-ended tasks using internet-scale knowledge of videos, wiki, and text information. It was an outstanding paper at NeurIPS 2022.
-
Digital Biology Foundation Model Predicts Coronavirus Variants, Wins ACM Prize
By
–
Digital biology took off. We trained largest biological foundation model for genome-scale modeling of #coronavirus to predict new variants of concern. It won the 2022 ACM Gordon Bell Special Prize for HPC-Based COVID-19 Research.
-
Neural Operators Accelerate Scientific Computing with Massive Speedups
By
–
Neural operators accelerated science. Carbon capture and storage modeling and weather forecasting achieved 4-5 orders of magnitude speedups. We improved mask optimization in lithography and inverse design of airfoils. They learned chaotic systems.
-
OpenAI Founder Makes Major Announcement on AI
By
–
And this is coming from one of the founders of OpenAI. Buckle up.
-
Appreciation for Yi Tay’s Research Papers Backstory
By
–
Really cool to hear the backstory behind all of @YiTayML
’s papers! -
2023 Will Accelerate AI Advancement and Adoption Significantly
By
–
Prediction: 2023 will make 2022 look like a sleepy year for AI advancement & adoption.