4/ Blogs on LLMs from wide range of authors
RESEARCH
-
Best Large Language Models Blogs and Applications Guide
By
–
Check out the best large language models blogs and applications available out there
-
AI-Powered Assessment Creation and Low-Stakes Testing
By
–
And AI is pretty good at helping you create assessments, we have some prompts here: https://
papers.ssrn.com/sol3/papers.cf
m?abstract_id=4391243
… Paper on low-stakes testing here: -
Building DBRX: Open Source LLM Development and Enterprise GenAI
By
–
What goes into building the most powerful open source LLM yet? @DbrxMosaicAI gives a glimpse into how they created #DBRX – from GPU decisions to benchmarking. Great read from @willknight @WIRED that shows why open source is critical for enterprise GenAI.
-
Loss Function Behavior in Deep Learning Training
By
–
also i think it would be pretty hard to artificially get the loss to jump like that after so many steps
-
Synthetic Data Quality Issues in AI Model Training
By
–
oh it wasn't fake because of this reason it's "fake" because some of the inputs are 1s not real data
-
Mosaic Databricks Releases Competitive New Open Model
By
–
legit new open model just dropped from Mosaic/Databricks.
Seems very competitive on offline benchmarks.
Check it out -
DBRX: New Efficient Open Source LLM Standard
By
–
#DBRX sets a new standard for efficient open source LLMs. While it has 132B total parameters, with its fine-grained MoE architecture, DBRX only uses 36B at any given time. Learn more about how we built #DBRX & benchmarked its performance. https://
dbricks.co/3J13hed -
Shuffling Within Batch in Contrastive Learning Practices
By
–
well i do shuffle; it's not standard to shuffle *within the batch*, for contrastive learning
-
DBRX: New Open Source Model Beats Grok and Competition
By
–
Scoop: Grok had a good run but there’s a new open source model that beats out the rest: DBRX. I got an inside look at the impressive work that went into building it: