If you find this work interesting, please join our Discord channel to ask questions and discuss. https://
discord.gg/8z2Pe7cpRv Also, thank you to @Thom_Wolf for help on setting up the leaderboard at: The Big Benchmarks Collection: https://
huggingface.co/collections/op
en-llm-leaderboard/the-big-benchmarks-collection-64faca6335a7fc7d4ffe974a
… (10/10)
INNOVATION
-
Open LLM Leaderboard benchmarks collection launched
By
–
-
ToolBench: Comprehensive AI Agent Orchestration Benchmark Suite
By
–
We create a comprehensive benchmark suite that covers a range of use cases. Using a single API call to do something useful to orchestrating and planning multiple API calls to solve a complex problem. The benchmark is called ToolBench, available at https://
github.com/sambanova/tool
bench
… (4/10) -
Open Source vs Proprietary AI Models: Performance Gap Analysis
By
–
We benchmark a wide variety of OSS and proprietary models from @AiEleuther @Meta @BigscienceW @StabilityAI @OpenAI @TIIuae @salesforce @BigCodeProject @databricks and others. We see a huge gap between proprietary models and OSS models. (5/10)
-
Open Source Models Progress With API Integration Capabilities
By
–
These capabilities allow models to access knowledge beyond their training data. OSS models have made progress with releases from @AiEleuther @Meta @BigscienceW @StabilityAI @TIIuae @salesforce @BigCodeProject @databricks however their ability to use software APIs is unclear(3/10)
-
Open Source LLMs Become Effective Tool Manipulators
By
–
TECHNICAL UPDATE: We are excited to share our work on how to enable OSS to become effective tool manipulators. https://
sambanova.ai/blog/enabling-
open-source-llms-to-become-effective-tool-manipulators/
… The benchmarks, leaderboard, and tuned models are available on @huggingface
. (1/10) -
Teaching LLMs to Use Tools Over Direct Computation
By
–
For example, it's better to teach a LLM to use a calculator rather than teaching it to do complex math. (2/10)
-
Upstage SOLAR-0-70b Reaches #1 LLM Ranking Achievement
By
–
It was #1 as of Aug 1, 2023 to Aug 10. Please check it out https://
huggingface.co/upstage/SOLAR-
0-70b-16bit
… (was upstage/Llama-2-70b-instruct-v2). Thanks! -

Gradient Descent Research Incubated at Google AI Becomes Osmo
By
–
Very pleased to have helped incubate this research led by @awiltschko and many others within @GoogleAI
, before spinning it out into http://
osmo.ai. The power of gradient de-scent methods! -
Continuous Learning to Stay Competitive in Technology
By
–
Stay Ahead of Rapid Changes: Technology evolves at lightning speed. To stay relevant and competitive in your field, you must continually update your knowledge and skills by constantly learning, and adapting to new tools, trends, and innovations in your field.