The Top ML Papers of the Week (March 25 – March 31): – DBRX
– Grok-1.5
– LLM2LLM
– Mini-Gemini
– Agent Lumos
– Long-form factuality in LLMs
…
LLMS
-
Top ML Papers of the Week: DBRX, Grok, LLM2LLM and More
By
–
-

DBRX: New 132B Open-Source LLM Outperforms Benchmarks
By
–
1). DBRX – a new 132B parameter open LLM that outperforms all the established open-source models on common benchmarks like MMLU and GSM8K; DBRX was pretrained on 12T tokens (text and code) and uses a mixture-of-experts (MoE) architecture.
-
Jamba Overview Highlights Novel Features for Developers
By
–
This Jamba overview is a great way to quickly understand the novel features Jamba brings to the dev community. Thanks @AiFlux
! -

Generative AI and LLMs Summit for Data Scientists
By
–
GPT & Generative AI and LLMs! @DataSciConnect #BigData #Analytics #DataScience #AI #MachineLearning #NLProc #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #Books #100DaysofCode https://
geni.us/Align-AI-Summi
ts
… -

Generative AI and LLMs: Summit and Resources Guide
By
–
GPT & Generative AI and LLMs! @DataSciConnect #BigData #Analytics #DataScience #AI #MachineLearning #NLProc #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #Books #100DaysofCode https://
geni.us/Align-AI-Summi
ts
… -

GPT Generative AI LLMs Summit: Data Science Tech
By
–
GPT & Generative AI and LLMs! @DataSciConnect #BigData #Analytics #DataScience #AI #MachineLearning #NLProc #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #Books #100DaysofCode https://
geni.us/Align-AI-Summi
ts
… -

GPT Generative AI LLMs Technologies Conference
By
–
GPT & Generative AI and LLMs! @starconfs #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #100DaysofCode https://
cstar.global -
Instructor-XL Model Shows Unusual Wikipedia Question Retrieval Prompt
By
–
Hah that one is so weird… https://
huggingface.co/hkunlp/instruc
tor-xl
… "Represent the Wikipedia question for retrieving supporting documents:" -
Sakana AI’s cost-efficient model merging with limited GPU resources
By
–
“At the time, @SakanaAILabs only had 16 GPUs, which cost $30K per month. That’s pennies compared to the $100M+ it took to train advanced models like GPT-4… Model merging isn’t perfect though. @SakanaAILabs is one of only a few firms who have attempted to automate this process.”
-
GPT-4 Turbo Output Limitations Explained
By
–
That's input though – the docs say output for gpt-4-turbo is limited to 4096