7/ Symmetry in Machine Learning – presents a unified and methodological framework to enforce, discover, and promote symmetry in ML; also discusses how these ideas can be applied to ML models such as multilayer perceptions and basis function regression.
RESEARCH
-
Next Generation AlphaFold Expands Structure Prediction Capabilities
By
–
8/ Next Generation AlphaFold – a new iteration of AlphaFold that greatly expands its range of applicability and shows capabilities of joint structure prediction of complexes including proteins, nucleic acids, small molecules, ions & modified residue.
-
Efficient Context Window Extension Method for Large Language Models
By
–
5/ Efficient Context Window Extension of LLMs – proposes a compute-efficient method for efficiently extending the context window of LLMs beyond what it was pretrained on; models of up to 128K context length reproduced.
-
Open DAC 2023: 38M DFT calculations MOF materials dataset
By
–
6/ Open DAC 2023 – introduces a dataset consisting of more than 38M density functional theory (DFT) calculations on more than 8,800 MOF materials containing adsorbed CO2 and/or H2O; properties for DAC are identified directly in the dataset.
-
LLMs Applied to Industrial Chip Design and Optimization
By
–
4/ LLMs for Chip Design – proposes using LLMs for industrial chip design by leveraging domain adaptation techniques; evaluates different applications for chip design such as assistant chatbot, electronic design automation, and bug summarization.
-
MetNet-3: Neural Weather Forecasting Model 24-Hour Predictions
By
–
1/ MetNet-3 – a SoTA neural weather model that extends the lead time range and variables of a predictive model that learns from both dense and sparse data sensors; makes predictions up to 24 hrs ahead for precipitation, wind, temperature,…https://t.co/9nz7ppVqSo
— DAIR.AI (@dair_ai) 5 novembre 20231/ MetNet-3 – a SoTA neural weather model that extends the lead time range and variables of a predictive model that learns from both dense and sparse data sensors; makes predictions up to 24 hrs ahead for precipitation, wind, temperature,…
-
Comprehensive Survey on LLM Evaluation Methods and Datasets
By
–
2/ Evaluating LLMs – a comprehensive survey (100+ pages) on evaluating LLMs, including discussions about the different types of evaluations, datasets, techniques, and more.
-
Top ML Papers: LLMs, AlphaFold, and Advanced Techniques
By
–
Top ML Papers of the Week (Oct 30 – Nov 5): – LLMs for Chip Design
– Battle of the Backbones
– Next Generation AlphaFold
– Symmetry in Machine Learning
– Enhancing LLMs by Emotion Stimuli
– Efficient Context Window Extension of LLMs
… -
Waymo vs Cruise: Assessing True Level 5 Autonomous Driving
By
–
My guess is that Waymo is markedly better than Cruise, but – One critical question is how much better; even an order of magnitude less intervention would still be a long way from true L5 self-driving
– The other rumor I hear is that Waymo is super-tailored to particular roads, -
Emergence of Specialized Domain-Specific LLMs in Finance and Law
By
–
In some very specific cases, we will also see some very specialized LLMs emerge – e.g. financeLLM or LegalLLM. These domain-specific LLMs that may require a lot of custom training, RLHF, and fine-tuning. /16