RESEARCH

Advances in Surgical AI: Skill Assessment and Patient Outcome Prediction

By

–

31 December 2022 22h56

We made strides in surgical #AI which involves assessing the skill of surgeons, predicting patient outcomes, and discovering novel surgeon biomarkers based on multi-modal data and deep learning algorithms. @AjhungMD gives an excellent overview here

ZerO: Deterministic Weight Initialization with Binary Values

By

–

31 December 2022 22h53

We developed the first fully deterministic weight initialization procedure for training any neural network. Our scheme, ZerO, initializes networks’ weights with only zeros and ones based on identity, and Hadamard transforms. ZerO achieves SOTA https://
arxiv.org/abs/2110.12661

Robust Vision Transformer Architecture Wins Semantic Segmentation Challenge

By

–

31 December 2022 22h51

We also developed robust vision transformer architecture, fully attention networks (FAN), with channel-based attention for robustness. We won the Semantic Segmentation Tracking of Robust Vision Challenge at ECCV. https://
arxiv.org/abs/2210.12852

Neural Operators Enable Single-Step Diffusion Model Image Generation

By

–

31 December 2022 22h50

2022 saw diffusion models for generative AI. But one downside is very slow sampling. We used neural operators to replace ODE solvers and showed that just one function evaluation is sufficient to achieve the best image generation quality. https://
arxiv.org/abs/2211.13449

MineDojo: Generalist AI Agents with Text Prompts in Minecraft

By

–

31 December 2022 22h47

Decision-Making with Generalist AI Agents: We built Minedojo framework in Minecraft with text prompts for open-ended tasks using internet-scale knowledge of videos, wiki, and text information. It was an outstanding paper at NeurIPS 2022.

Digital Biology Foundation Model Predicts Coronavirus Variants, Wins ACM Prize

By

–

31 December 2022 22h45

Digital biology took off. We trained largest biological foundation model for genome-scale modeling of #coronavirus to predict new variants of concern. It won the 2022 ACM Gordon Bell Special Prize for HPC-Based COVID-19 Research.

Neural Operators Accelerate Scientific Computing with Massive Speedups

By

–

31 December 2022 22h42

Neural operators accelerated science. Carbon capture and storage modeling and weather forecasting achieved 4-5 orders of magnitude speedups. We improved mask optimization in lithography and inverse design of airfoils. They learned chaotic systems.