Once again, we must prepare ourselves for the fact that many professions will disappear in the future. In a way, it is an irony of history that it was always believed that physical jobs would be the first to be eliminated by automation so that we could devote ourselves to the
GENERATIVE AI
-
GPQA Benchmark for Advanced LLM Evaluation
By
–
The GPQA (Graduate-Level Google-Proof Q&A) benchmark is a challenging dataset designed to assess the capabilities of large language models (LLMs) in handling complex, domain-specific questions in biology, physics, and chemistry. It consists of 448 multiple-choice questions
-

o1 reaches level 2 for writing tasks
By
–

o1 has a chance to mark level 2 for writing tasks finally It feels to have much better instruction-following than all previous models. Looking forward to testing it with web search capabilities. Such a model, paired with a big RAG would also make it huge for research!
-
Reaction to SearchGPT Release and Excitement
By
–
Good question. I really like how excited he was yesterday when they released searchGPT. Yours?
-
Model Swarms: Collaborative LLM Expert Algorithm via Swarm Intelligence
By
–
New from @UW and @GoogleDeepMind
: Model Swarms, a collaborative search algorithm that adapts LLM experts to single task, multi-task domains, and reward models via swarm intelligence. Talk to the team @ZifengWang315 @chl260 @YejinChoinka @tsvetshop here! https://
alphaxiv.org/abs/2410.11163
v1
… -
China Develops Military AI Using Meta’s Llama Model
By
–
China develops AI for military use, violating Meta's policies „Chinese scientists announced the development of an AI model for military purposes, utilizing Meta's publicly available Llama model.“
-
When Will OpenAI Unleash O2 Model Release
By
–
not that much longer hopefully! how long until the calls to unleash o2?
-
ChatGPT Growth Surge Demonstrates Strong Team Performance
By
–
chatgpt growth is wild recently very proud of the team!
-
Google’s Gemini Inference Systems Expert Emanuel Shares Production Knowledge
By
–
Don't miss this! Emanuel is one of my treasured colleagues for many, many years (I think we've made 20,000 cappuccinos together). He's got awesome knowledge of nearly every aspect of Google's production systems (including Gemini inference systems).
-

AMD OLMo 1B: Efficient Open-Source Language Model Released
By
–
Smol models ftw! @AMD released AMD OLMo 1B – beats OpenELM, tiny llama on MT Bench, Alpaca Eval – Apache 2.0 licensed > Trained with 1.3 trillion (dolma 1.7) tokens on 16 nodes, each with 4 MI250 GPUs > Three checkpoints: – AMD OLMo 1B: Pre-trained model
– AMD OLMo 1B SFT: