Top GitHub Repos you can't miss this week: We gathered amazing community projects, from free LLM course, open-source research agents, Chatbot UI, and more. Here's everything you need to know:
@alphasignalai
-
Microsoft FP4 Quantization Framework Achieves Comparable Accuracy to FP8
By
–
5/ Microsoft introduces their framework for FP4 quantization training. FP4 was regarded unfeasible due to too much degradation, but the proposed method in this paper achieves accuracy that is comparable to FP8 and BF16. This means less computational demand to use LLMs, while
-
Top AI Papers: RL, SFT, Hallucination, FP4 Quantization
By
–
Top AI Papers you Can't miss from last Week: We summarized everything from RL vs. SFT training, Hallucination Mitigation with Multi-agent systems, Microsoft's New FP4 Quantization, and more. Here's everything you need to know:
-
Technical Report: Gemma Model by DeepMind Released
By
–
Technical report: https://
storage.googleapis.com/deepmind-media
/gemma/gemma-report.pdf
… -
RAG Demo Tutorial Notebook Visualization Code
By
–
Code here: https://
github.com/Renumics/rag-d
emo/blob/main/notebooks/visualize_rag_tutorial.ipynb
… -
Gemini V1.5 Technical Report Released by DeepMind
By
–
Technical Report: https://
storage.googleapis.com/deepmind-media
/gemini/gemini_v1_5_report.pdf
… -
Google Unveils Gemini, Its Next-Generation AI Model
By
–
https://blog.google/technology/ai/google-gemini-next-generation-model-february-2024/
-
Children Experience 50x More Data Than Largest Language Models
By
–
I've made that point before:
– LLM: 1E13 tokens x 0.75 word/token x 2 bytes/token = 1E13 bytes.
– 4 year old child: 16k wake hours x 3600 s/hour x 1E6 optical nerve fibers x 2 eyes x 10 bytes/s = 1E15 bytes. In 4 years, a child has seen 50 times more data than the biggest LLMs. x.com/tomosman/statu… -
Code Llama 70B Release: New High-Performance Code Generation Model
By
–
Today we’re releasing Code Llama 70B: a new, more performant version of our LLM for code generation — available under the same license as previous Code Llama models. Download the models https://
bit.ly/3Oil6bQ
• CodeLlama-70B
• CodeLlama-70B-Python
• CodeLlama-70B-Instruct