Agent-based manipulation of APIs using #LLMs is a popular approach, but consistent and reliable evaluation metrics to assess this has been lacking. In this poster, we introduce a set of benchmarks called ToolBench and evaluate multiple open source #LLMs. @SambaNovaAI Researcher
@sambanovaai
-
Conformal Prediction: Quantifying ML Model Uncertainty via Regression
By
–
.
@SambaNovaAI researcher @etash_guha will be presenting "Conformal Prediction via regression-as-classification" at the Regulatable ML Workshop at #NeurIPS2023. Conformal Prediction is a way of quantifying the uncertainty of ML model. There are many methods that work well for -
Open LLMs Tool Manipulation for GPT Agents
By
–
.
@SambaNovaAI will be presenting our work on the tool manipulation capabilities of open #LLMs at the Foundation Models for Decision Making Workshop at #NeurIPS2023. Come check out this work to understand how far we are from creating #GPT Agents using open models. Check out a -
SambaNova adapts language models to Thai and Hungarian efficiently
By
–
.
@SambaNovaAI researchers will present their work on adopting #llamas to new languages at the Efficient Natural Language and Speech Processing Workshop at #NeurIPS2023. We show how to adopt to Thai and Hungarian with minimal data and without compromising base capabilities. -
SambaNova Sponsors NeurIPS Instruction Tuning Workshop
By
–
.
@SambaNovaAI is proud to sponsor the @itif_workshop at #NeurIPS2023. The workshop will cover exciting research in instruction tuning and following and evaluation of instruction tuned models. The workshop features invited talks, peer reviewed papers, and a panel. Speakers -
Chip Architecture Efficiency Critical Beyond Raw Computing Power
By
–
"More powerful chips and more memory will always be needed, but if this isn’t combined with architecture that ensures the chips are used effectively, the number of chips required, along with their energy demands, will quickly become unmanageable." https://
ft.com/content/be17c8
70-bc0c-42c2-9f39-fb8a6a17f2a5
…
via @FT -
Enterprise AI Adoption Takes Center Stage in 2024
By
–
"2023 saw the consumer world embracing generative AI with ChatGPT, but 2024 will be all about the enterprise." – @SambaNovaAI CEO @RodrigoLiang quoted in @IBDinvestors https://
investors.com/news/technolog
y/nvidia-stock-walks-tall-among-ai-stocks-what-could-trip-it-up/
… #enterpriseAI #ai #ml #chatgpt -
Retrieval Augmented Generation Boosts Accuracy in SambaNova Suite
By
–
BLOG: Retrieval Augmented Generation in SambaNova Suite RAG support can greatly increase the accuracy of responses, ultimately driving greater value to the organization. Learn more: https://
sambanova.ai/blog/rags/ #LLM #AI -
SambaStudio Adds Text Embedding Models RAG Capabilities
By
–
TECH BLOG: SambaStudio now supports text embedding models, enhancing #LLMs with Retrieval Augmented Generation (RAG) capabilities. RAG improves base LLMs on factuality, reduced hallucinations, and more by providing correct context to the LLM. https://
sambanova.ai/blog/introduci
ng-text-embedding-model-support-in-sambastudio-elevating-information-retrieval-and-augmenting-large-language-models/
… #ai #ml -
Composition of Experts Vision Accelerated by SN40L Research
By
–
These ideas are very aligned with the vision of composition-of-experts that SN40L can help accelerate! Papers covered in the talk – 1. https://
arxiv.org/abs/2303.14177
2. https://
arxiv.org/abs/2208.03306 Thank you for the wonderful talk and looking forward to more of your research!