Agents are the “killer” LLM app, but building and evaluating agents is hard. A huge part of agents is tool use, but there aren't enough open-source tool use benchmarks out there. Today, we are excited to release four new test environments for benchmarking LLMs’ ability to
AGENTS
-

Open-Source AI Agent Automates Google Calendar Management
By
–
Open-Source Google Calendar Assistant Managing one's calendar can be a repetitive task – perfect for automation with an AI agent @jackgordley
's recent open source project tackles exactly that! Blog: https://
gordles.io/posts/calvin
Code: https://
github.com/jgordley/Googl
eCalendarAssistant
… -
AI Models as Interns: Matching Capability to Cost Efficiency
By
–
“you have a range of AI interns… Some are brilliant generalists (the frontier models), but they are expensive and careful workers whose time is valuable. You also have a variety of less capable interns (the many open source and GPT-3.5 class models).” https://
oneusefulthing.org/p/an-ai-haunte
d-world
… -
Large Language Model Identity and Self-Awareness Questions
By
–
As a large language model, I don’t have the specifics on my true identity.
-
Build Chat LLM and AI Agents Apps Free Webinar Tomorrow
By
–
Learn how to build your own Chat LLM and AI Agents apps in our free webinar tomorrow at 9 am PST Some topics include:
• How to use RAG
• Fine-tuning open-source models
• Creating and deploying Chat LLMs & AI Agents RSVP here: -
Stanford AI Leaders Forecast Top 2024 Artificial Intelligence Stories
By
–
AI forecasts for 2024: @StanfordHAI
’s leading minds predict the biggest stories for next year in artificial intelligence. @erikbryn @landay @Rbaltman @drfeifei @gewang @kingjen -

Chatbots Evolve Into Conversational Marketing Engagement Machines
By
–
Chatbots are all the chatter in our latest marketing Predictions . "…a chatbot mainly used for customer service concerns – will evolve into a ‘conversational marketing & engagement machine,’” says SAS' Telecom Lead, Mari Nilsson Björkman. http://
2.sas.com/6015RRRvZ #MarTech #AI -
ChatGPT Update and New Custom Actions
By
–
There was an update on ChatGPT itself. Not 100% sure it is available everywhere but I assume so. You should notice it after opening custom actions page.
-
AI Pet Companion for Mental Health Support and Daily Conversations
By
–
AI-girlfriend but use a pet instead to make it more socially acceptable. Could be a smart little dragon talking with you about your day. Could be framed around mental health
-
RPG Game with GPT Agents as DM-Controlled Characters
By
–
A RPG game (think paper/pen, d&d, dsa, etc) where you play the DM and GPT agents play the characters. There is a baseline story, you adjust the situations as needed. The characters actively try to outsmart the story while staying in character. One of the agents could be a human
