most useful bit of code I've written all year: call map() on a HuggingFace dataset in torch distributed mode (like DDP) as one example, this will let you compute embeddings for a dataset in parallel, using all the GPUs you have http://
gist.github.com/jxmorris12/69a
730fee174f5309968e984c298f8f2
…
@jxmnop
-
Parallel Dataset Embedding Computing with HuggingFace and DDP
By
–
-
Computational Sub-area Emerges Within Prompt Engineering
By
–
cs will be the computational sub area of the prompt engineering department
-
Prompt Engineering: The English Major Plot Twist
By
–
plot twist, the real prompt engineering major was just English all along
-
When Will Cornell CS Offer Prompt Engineering Major?
By
–
how many years until Cornell CS allows people to major in Prompt Engineering?
-
Managing ML Training Runs: Preventing Micromanagement Through Accountability
By
–
giving my wandb password to my roommate for a few days to stop myself from logging in and micromanaging training runs
-
LLMs at NLP Conferences: A Domain Mismatch Discussion
By
–
I think this is a really good idea. Sometimes talking about LLMs at NLP conferences feels like talking about chemistry with a bunch of particle physicists