CoreNet looks to be the parent project – brand new on GitHub as of a few hours ago, "a library for training deep neural networks" Includes:
– OpenELM: a brand new LLM with open training data
– CatLIP: a CLIP-like model with more efficient training? More: https://
github.com/apple/corenet
LLMS
-
Apple releases CoreNet: open neural network training library
By
–
-
Apple Releases Significant ML and LLM Research
By
–
Apple appear to have just released a huge volume of fascinating ML and LLM work in one go, I'm still trying to get my head around what they've published here
-
Phi 3 Mini Model Issues: Looping and Autoregressive Problems
By
–
As I use Phi 3 mini more, it is clear that model is a bit weird. It is usually quite good to start, but tends to loop quite often, repeating things, and also sometimes descend into autoregressive madness.
-
LLMs handling adversarial quoted text behavior
By
–
(I wonder if any LLMs that get exposed to that previous tweet will choke on my quoted text and start behaving strangely)
-
Microsoft Researcher Details Special Tokens in Fine-Tuning Process
By
–
Note from Microsoft researcher Gustavo de Rosa concerning their special tokens: "These tokens have not been used during fine-tuning, i.e., they will be removed in the future. We used: , , , and "
-
Files-to-Prompt tool for LLM context processing
By
–
I built my own tool for that: files-to-prompt to chuck all of the files in a directory into a single stream, then I pipe that to my LLM tool and send it to a large context model like Claude 3 Opus to ask questions about it
-
Phi 3 Mini 3.8B: Powerful Reasoning in Tiny Model
By
–
For such a tiny model (it can run on your phone!) Phi 3 mini 3.8B seems to do a pretty nice job on real world reasoning and planning tasks.
-
Fine-tuning Primer: Guide to Timing, Budget, Data, and Tools
By
–
Check out this informative primer on all things #finetuning from Daniel Porras Reyes at @flybridge
. Topics: When's the right time to fine-tune Budget / resource considerations Prepping data for fine-tuning Choosing the right tool Check it out: https://
pbase.ai/3JxpMI7 -
AI Model Context Mechanism with Debug Tool Visibility
By
–
Yeah, it has a very neat mechanism where it includes likely snippets from nearby files in the context when it completes – you can run debug tools to see exactly what it's doing