4/ Fine-Tuning LLMs for Factuality – fine-tunes language model for factuality without requiring human labeling; it learns from automatically generated factuality preference rankings and targets open-ended generation settings.
@dair_ai
-
Chain-of-Note Improves RAG Model Robustness Against Noisy Documents
By
–
2/ Chain-of-Note – an approach to improve the robustness and reliability of retrieval-augmented language models in facing noisy, irrelevant documents and in handling unknown scenarios.
-
Enhancing LLMs Understanding through Emotional Stimuli Research
By
–
9/ Enhancing LLMs by Emotion Stimuli – explores the ability of LLMs to understand emotional stimuli; conducts automatic experiments on 45 tasks using various LLMs, including Flan-T5-Large, Vicuna, Llama 2, BLOOM, ChatGPT, and GPT-4.
-
FP8 Low-Precision Training Improves LLM Efficiency Without Hyperparameter Changes
By
–
10/ FP8-LM – finds that when training FP8 LLMs most variables, such as gradients and optimizer states, in LLM training, can employ low-precision data formats without compromising model accuracy and requiring no changes to hyper-parameter.
-
Symmetry Framework in Machine Learning Models
By
–
7/ Symmetry in Machine Learning – presents a unified and methodological framework to enforce, discover, and promote symmetry in ML; also discusses how these ideas can be applied to ML models such as multilayer perceptions and basis function regression.
-
Next Generation AlphaFold Expands Structure Prediction Capabilities
By
–
8/ Next Generation AlphaFold – a new iteration of AlphaFold that greatly expands its range of applicability and shows capabilities of joint structure prediction of complexes including proteins, nucleic acids, small molecules, ions & modified residue.
-
Efficient Context Window Extension Method for Large Language Models
By
–
5/ Efficient Context Window Extension of LLMs – proposes a compute-efficient method for efficiently extending the context window of LLMs beyond what it was pretrained on; models of up to 128K context length reproduced.
-
Open DAC 2023: 38M DFT calculations MOF materials dataset
By
–
6/ Open DAC 2023 – introduces a dataset consisting of more than 38M density functional theory (DFT) calculations on more than 8,800 MOF materials containing adsorbed CO2 and/or H2O; properties for DAC are identified directly in the dataset.
-
LLMs Applied to Industrial Chip Design and Optimization
By
–
4/ LLMs for Chip Design – proposes using LLMs for industrial chip design by leveraging domain adaptation techniques; evaluates different applications for chip design such as assistant chatbot, electronic design automation, and bug summarization.
-
Comprehensive Survey on LLM Evaluation Methods and Datasets
By
–
2/ Evaluating LLMs – a comprehensive survey (100+ pages) on evaluating LLMs, including discussions about the different types of evaluations, datasets, techniques, and more.