can i just shuffle better somehow? I assumed this is what happens when you reuse the same shuffling bt epochs
@jxmnop
-
Fixing HuggingFace Default Sampling Behavior Without Replacement
By
–
thanks, your curves look a tiny bit different but I believe it; i however have the practical question of why is this happening with the huggingface defaults and how do i make it stop? (i don't want to sample w/ replacement)
-
HF Trainer Automatic Shuffling for Model Training
By
–
i’m just using HF trainer! it’s supposed to shuffle for me
-
Investigating Staircase Loss Curves in HuggingFace Trainer Training
By
–
has anyone seen these staircase loss curves before and really figured out what's going on? my two leading theories are that the loss is getting averaged somewhere behind the scenes (don't know where) and that the data isn't shuffled between epochs. i'm using huggingface trainer.
-
Research Ethics: Medical AI Studies Should Be Conducted at Institutions
By
–
I did read the paper! I deleted the tweet because you feel this way but i think the whole line of research is at the very least probably something that should be conducted at a medical institution (not google)
-
Google Clinicians AI Healthcare Workforce Recognition
By
–
oh that’s cool— thanks for pointing this out 🙂 i just noticed they all worked at Google and didn’t think any clinicians work there.
-
Why MOOCs Beat Books and Videos for Online Learning
By
–
right! why else would people sign up for free online MOOCs if they could just learn from a book or videos on their time
-
Internal Barriers Matter More Than External Tools
By
–
this is the same reason why your friend sending you a PDF of workouts doesn't make you stronger, or buying new running shoes doesn't make you faster, 90% of the barriers are internal
-
Why Free Education Resources Alone Cannot Transform Human Learning
By
–
i don't think this is right at all; the reason why having every textbook pdf ever available for free and every course available on youtube didn't change humanity is simple, learning things takes so much ENERGY; most people have had textbooks for a century but most go unread
-
Hugging Face History: From Chatbot to Transformers Library
By
–
you’re a real NLP person if you remember that Hugging Face started as an AI girlfriend chatbot company and huggingface/transformers used to be called pytorch-pretrained-bert