I've seen plenty of folks doing RLHF with <5 dedicated people! (And I do all my own data engineering — it doesn't take too long after a few decades of practice…)
MACHINE LEARNING
-
PEFT Kaiming Init Optimization Patch for Training
By
–
The issue is that PEFT spends all that time doing unnecessarily doing kaiming init. So our code first patches the `init` module so that `kaiming_uniform_` does nothing at all. Here's a gist with the full code:
-
Speed up Hugging Face PEFT model initialization with this trick
By
–
If you use @huggingface PEFT, then you'll have noticed that calling `get_peft_model` is *really* slow… However, you can make it nearly instant by running this magic snippet first!
-
Software Engineering Best Practices for Data Scientists
By
–
Software Engineering for Data Scientists https://
bit.ly/3rhXdsD #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Poe API v2 Enables Free Bot-to-Bot Queries for Developers
By
–
Introducing the Poe API v2 for developers! First, this now lets any bot on Poe to query any other bot for free and use the output as input. Developers do not have to pay anything for this; any messages used are covered under users' normal free messages on Poe. (thread)
-
Upcoming Conversation with Geoffrey Hinton on AI
By
–
Can’t wait for my in-person (and online) conversation with Geoff @geoffreyhinton in a few hours!
-
Fast SDXL Inference with JAX on TPU v5e
By
–
Fast SDXL Inference with JAX on TPU v5e Amazing how fast anyone can generate 4 1024×1024 resolution SDXL images in under 5 seconds, for free: https://
huggingface.co/spaces/google/
sdxl
… -
XGBoost Community Celebrates Major Milestone with Global Contributors
By
–
Congrats to the XGBoost community and the contributors around the world who enabled this
-
Domino Data Lab Named Leader in AI and ModelOps
By
–
Domino Data Lab is a Leader in two market studies by Dresner Advisory! Ranked #1 in AI, Data Science, & ModelOps. Thank you to our customers for allowing us to build our market-leading solution. Learn more: https://
domino.buzz/3PI1dLf #AI #DataScience #ModelOps #EnterpriseAI -
Prof. Ogata’s Neural Language Generation Pioneer Work Highlighted
By
–
Looking forward to today's @ieeeiros keynote by Prof. Tetsuya Ogata @tetsuyaogata1
. Did you know he was already doing neural language generation in 2011? https://
sciencedirect.com/science/articl
e/pii/S0893608011000207
…