Great, thanks for sharing Yao. As mentioned on the leaderboard we are using the MMLU of the Eleuther harness for now but we're in the process of adding all the evals of the MMLU of HELM which is closer to the original prompts soon (actually working on it as we speak this weekd).
LLMS
-
Largest Model Currently Available and Future 120B Model Rumors
By
–
That would be 40B. As far as I know, that’s currently the largest one. A 120B one is in the works though according to rumors.
-
Advanced Techniques for LLM Data Connection Beyond Semantic Search
By
–
When connecting LLMs to your data, semantic search is a great first pass – but to get even better performance you can turn to more advanced techniques: Contextual Compression
Self Query
Time weighting Going live in 30m to talk about this and more! -
Data-Centric AI Adoption for Enterprise LLM Innovation
By
–
Up next is an exciting chat with Nurtekin Savas @CapitalOne about adopting #data-centricai for the enterprise AI stack, its role in driving AI innovation with #LLMs, #genAI, and ensuring accuracy, security, compliance. https://
future.snorkel.ai -
Free Generative AI Conference on LLMs and AI Agents July 11
By
–
Free Generative AI Conference on LLMs and AI Agents! July 11. We'll discuss building custom LLMs, simple AI agents, and the future of generative AI. You can register now: https://
eventbrite.com/e/stateofthear
t-free-generative-ai-conference-on-llms-and-ai-agents-tickets-641826449187
…. -
Single Epoch Training on 52k Alpaca Dataset
By
–
This was for one iteration/epoch over the 52k Alpaca dataset.
-
LLaMA-Adapter Works with Any LLM, Including Falcon 40B
By
–
Fun fact: LLaMA-Adapter is not LLaMA-specific. You can use it to finetune any LLM.
— Sebastian Raschka (@rasbt) 8 juin 2023
Below, I finetuned a 40B Falcon model using LLaMA-Adapter (it also works on a single GPU with 20 GB RAM).
Have been heads down tinkering & will follow up with more benchmarks! https://t.co/2Fr6faChv2Fun fact: LLaMA-Adapter is not LLaMA-specific. You can use it to finetune any LLM. Below, I finetuned a 40B Falcon model using LLaMA-Adapter (it also works on a single GPU with 20 GB RAM). Have been heads down tinkering & will follow up with more benchmarks!
-
Was This Science Paper Written by LLM or Scientist?
By
–
Was the science paper written by a scientist or a LLM? https://
cell.com/cell-reports-p
hysical-science/fulltext/S2666-3864(23)00200-X
… -
GPT Models Now Available for US Federal Agencies on Azure
By
–
GPT models will soon be available for federal agencies using Azure:
-
Running a Business Solely with ChatGPT: Hustle GPT
By
–
I've just released a fascinating new video on my YouTube channel that you absolutely must see: "What’s Hustle GPT: Can you really run a business solely using ChatGPT?" You can watch it here: https://
youtube.com/watch?v=2AAezO
JqHtw
… #AI #ChatGPT #HustleGPT #Automation #BusinessFuture