If you are working on the NeurIPS LLM Efficiency Challenge, Dolly 15k support is now merged: https://
github.com/Lightning-AI/l
it-gpt/pull/430
… python scripts/prepare_dolly.py
python finetune/lora.py –data_dir data/dolly/
@rasbt
-
Dolly 15k Support Merged for NeurIPS LLM Efficiency Challenge
By
–
-
Platypus: Open-Source LLM Achieves Top Leaderboard Performance
By
–
Platypus, a new open-source LLM at the top of the leaderboard: https://
arxiv.org/abs/2308.07317 Key points are
1) a curated dataset: removing similar & duplicate questions
2) finetuning and merging Low Rank Approximation (LoRA) modules: focusing on the non-attention modules -
Machine Learning as Assembling Furniture from Existing Pieces
By
–
Sometimes ML feels like trying to assemble new furniture from pieces of existing furniture 😀
-
Personal fork of open-source LLM code repository
By
–
And a personal fork of an open-source LLM code repo 🙂
-
Adding Falcon to the List, Removing Bloom from Recommendations
By
–
I'd definitely add Falcon to the list (and remove Bloom, which was pre-2023)
-
arXiv Team Would Welcome More Papers with Code Integrations
By
–
Saying this as former arXiv moderator, I think the team would be happy about further integrations similar to Papers with Code
-
NumPy PyTorch pandas loc index stop point reminder
By
–
If you are a NumPy & PyTorch user and occassionally use pandas for data processing … Here's a reminder that .loc includes the index stop point
-
Keep Machine Learning Research Open Source, Not Behind Paywalls
By
–
Lol yes, but pls keep it open source. Don’t want to go back to the medieval ages where we had papers without code repos
-
Neural Network Training Timeline and Educational Implementation
By
–
For a whole neural network? A year ago, for a multilayer perceptron for teaching purposes