You simply cannot squeeze the information content of a trained LLM (even a tiny one) in 800MB.
CODE
-
Minimal Code Architecture Enables Massive Learning
By
–
The code that specifies the architecture is tiny.
That's precisely my point.
There is a tiny amount of prior structure and a lot of learning. -
Karpathy’s LLM Technical Explainer: Essential 101 Guide
By
–
3 different people have sent me this video in under 24hrs, so I watched it and can confirm this is a VERY clear, accessible and spot on practical technical explainer of LLMs… great 101… by the ever-awesome @karpathy – highly recommended
-

Building Transformers: Concept and Implementation from Scratch
By
–
Transformer: Concept and code from scratch https://
bit.ly/45YXobu #AI #MachineLearning #DeepLearning #LLMs #DataScience -
4 Open-Source GPT-4 Vision Alternatives: Qwen-VL and CogVLM
By
–
Looking for open-source #GPT4 Vision alternatives? Here are 4 excellent options Qwen-VL
– Code: https://
github.com/QwenLM/Qwen-VL
– Paper: https://
arxiv.org/abs/2308.12966
– Demo: https://
colab.research.google.com/github/camendu
ru/Qwen-VL-Chat-colab/blob/main/Qwen_VL_Chat_colab.ipynb
… CogVLM
– Code: https://
github.com/THUDM/CogVLM
– Paper: https://
arxiv.org/abs/2311.03079
– Demo: -

Q-Learning Graph Networks for SAT Solver Branching Heuristics
By
–
Can Q-Learning with Graph Networks Learn a Generalizable Branching Heuristic for a SAT Solver? Kurin et al.: https://
arxiv.org/abs/1909.11830 #DeepLearning #QLearning #ReinforcementLearning -

A* Search Without Expansions: Deep Q-Networks Heuristics
By
–
A* Search Without Expansions: Learning Heuristic Functions with Deep Q-Networks Agostinelli et al.: https://
arxiv.org/abs/2102.04518 #ArtificialIntelligence #DeepQNetworks #ReinforcementLearning -

Implementing Llama from Scratch: A Practical Guide
By
–
Llama from scratch (or how to implement a paper without crying) https://
bit.ly/3PmBVCi #AI #MachineLearning #DeepLearning #LLMs #DataScience -
AutoTrain Local Training Feature Coming Next Week
By
–
Training locally available in AutoTrain next week!