8/ Next Generation AlphaFold – a new iteration of AlphaFold that greatly expands its range of applicability and shows capabilities of joint structure prediction of complexes including proteins, nucleic acids, small molecules, ions & modified residue.
@dair_ai
-
Symmetry Framework in Machine Learning Models
By
–
7/ Symmetry in Machine Learning – presents a unified and methodological framework to enforce, discover, and promote symmetry in ML; also discusses how these ideas can be applied to ML models such as multilayer perceptions and basis function regression.
-
Open DAC 2023: 38M DFT calculations MOF materials dataset
By
–
6/ Open DAC 2023 – introduces a dataset consisting of more than 38M density functional theory (DFT) calculations on more than 8,800 MOF materials containing adsorbed CO2 and/or H2O; properties for DAC are identified directly in the dataset.
-
Efficient Context Window Extension Method for Large Language Models
By
–
5/ Efficient Context Window Extension of LLMs – proposes a compute-efficient method for efficiently extending the context window of LLMs beyond what it was pretrained on; models of up to 128K context length reproduced.
-
LLMs Applied to Industrial Chip Design and Optimization
By
–
4/ LLMs for Chip Design – proposes using LLMs for industrial chip design by leveraging domain adaptation techniques; evaluates different applications for chip design such as assistant chatbot, electronic design automation, and bug summarization.
-
Comprehensive Survey on LLM Evaluation Methods and Datasets
By
–
2/ Evaluating LLMs – a comprehensive survey (100+ pages) on evaluating LLMs, including discussions about the different types of evaluations, datasets, techniques, and more.
-
MetNet-3: Neural Weather Forecasting Model 24-Hour Predictions
By
–
1/ MetNet-3 – a SoTA neural weather model that extends the lead time range and variables of a predictive model that learns from both dense and sparse data sensors; makes predictions up to 24 hrs ahead for precipitation, wind, temperature,…https://t.co/9nz7ppVqSo
— DAIR.AI (@dair_ai) 5 novembre 20231/ MetNet-3 – a SoTA neural weather model that extends the lead time range and variables of a predictive model that learns from both dense and sparse data sensors; makes predictions up to 24 hrs ahead for precipitation, wind, temperature,…
-
Top ML Papers: LLMs, AlphaFold, and Advanced Techniques
By
–
Top ML Papers of the Week (Oct 30 – Nov 5): – LLMs for Chip Design
– Battle of the Backbones
– Next Generation AlphaFold
– Symmetry in Machine Learning
– Enhancing LLMs by Emotion Stimuli
– Efficient Context Window Extension of LLMs
… -
Branch-Solve-Merge: Advanced LLM Reasoning Framework
By
–
10/ Branch-Solve-Merge Reasoning in LLMs – an LLM program that enables an LLM to plan a decomposition of a task into multiple parallel sub-tasks, independently solve them, and fuse solutions to the sub-tasks.
-
Managing AI Risks: Social Harms and Autonomous System Challenges
By
–
9/ Managing AI Risks – a short paper outlining risks from upcoming and advanced AI systems, including an examination of social harms, malicious uses, and other potential societal issues emerging from the rapid adoption of autonomous AI systems.