Agent-based manipulation of APIs using #LLMs is a popular approach, but consistent and reliable evaluation metrics to assess this has been lacking. In this poster, we introduce a set of benchmarks called ToolBench and evaluate multiple open source #LLMs. @SambaNovaAI Researcher
RESEARCH
-
Google Gemini Model Presentation at NeurIPS 2023
By
–
Want to learn more about the new Google Gemini model? Join Jeff Dean and members of the Gemini team at the #NeurIPS2023 Google booths today at 1:30pm to hear all about it!
-
Andrew McCallum’s OpenReview: Advancing AI Research Review
By
–
Hanging out with an old friend and one of the unsung heroes of AI research — @andrewmccallum has been running @openreviewnet for the past decade as a non-profit. The improvements that this brought to AI and to academic reviewing — including running reviewing at NeurIPS, ICML,
-
NVIDIA Research Advances Generative AI Robotics at NeurIPS
By
–
#NVIDIAResearch collaborates with leading universities to advance #generativeAI, robotics, & natural sciences. At #NeurIPS, they'll present industry leading innovations in text-to-image transformation, photo-to-3D avatar conversion, & specialized robots.
-
Google DaTaSeg: Universal Multi-Task Segmentation Model
By
–
Attending #NeurIPS2023? At 12:45pm, visit the Google booth where Xiuye Gu will describe DaTaSeg, a universal multi-dataset, multi-task segmentation model well-suited for memory-limited applications, e.g., for multiple segmentation tasks on mobile devices.
-
Runway Team at NeurIPS Conference Hosts Friends Dinner
By
–
The Runway team is at @NeurIPSConf for a week full of talks, papers and workshops. Join us tomorrow night for our Runway NeurIPS Friends Dinner: https://
partiful.com/e/GEYtSbPba0au
QELKQtx2
… -
AI Model Reasoning Capabilities: Family Relation Logic Test
By
–
It's shockingly good at reasoning! Notably, GPT-4 got this question wrong! The question:
If my dad is my friend's first cousin, and her first cousin is my other friend's uncle, how are my two friends related? -
Deploying Large Language Models in Production: Key Lessons
By
–
Deploying LLMs in Production: Lessons Learned https://
bit.ly/4a2NOa5 #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Intelligence Alone Doesn’t Drive Human Domination and Success
By
–
If it were true that raw intelligence was sufficient for a human to want to dominate others and succeed at it, then Albert Einstein, Richard Feynman, Leonard Euler, Niels Abel, Kurt Gödel and other scientists would have been both rich and powerful, and they were neither.
1.
