Here are some OpenELM weights on a Hugging Face, anyone got these working yet?
@simonw
-
OpenELM Training Data Sources Documentation
By
–
This is the best documentation I could find of the OpenELM training data – it looks like the bulk of it comes from RefinedWeb, RedPajama, The Pile and Dolma https://
github.com/apple/corenet/
blob/main/projects/openelm/README-pretraining.md
… -
Apple releases CoreNet: open neural network training library
By
–
CoreNet looks to be the parent project – brand new on GitHub as of a few hours ago, "a library for training deep neural networks" Includes:
– OpenELM: a brand new LLM with open training data
– CatLIP: a CLIP-like model with more efficient training? More: https://
github.com/apple/corenet -
Apple Releases Significant ML and LLM Research
By
–
Apple appear to have just released a huge volume of fascinating ML and LLM work in one go, I'm still trying to get my head around what they've published here
-
LLMs handling adversarial quoted text behavior
By
–
(I wonder if any LLMs that get exposed to that previous tweet will choke on my quoted text and start behaving strangely)
-
Microsoft Researcher Details Special Tokens in Fine-Tuning Process
By
–
Note from Microsoft researcher Gustavo de Rosa concerning their special tokens: "These tokens have not been used during fine-tuning, i.e., they will be removed in the future. We used: , , , and "
-
Files-to-Prompt tool for LLM context processing
By
–
I built my own tool for that: files-to-prompt to chuck all of the files in a directory into a single stream, then I pipe that to my LLM tool and send it to a large context model like Claude 3 Opus to ask questions about it
-
GPT-3 and Copilot Examples for URL Guessing and Testing
By
–
I have a few examples in https://t.co/aymMPeMsdG and https://t.co/n38dNNX8Vw pic.twitter.com/jPEzopNALi
— Simon Willison (@simonw) 23 avril 2024I have a few examples in https://
til.simonwillison.net/gpt3/guessing-
amazon-urls
… and https://
til.simonwillison.net/gpt3/writing-t
est-with-copilot
… -
User adoption challenges switching from Copilot to alternative AI tools
By
–
I tried it once but it didn't stick for me, I think because I've invested so much time in Copilot and don't want to have to spend the time figuring out all of the intuitions needed for something else