With Claude 3 APIs available, I would love to see more academics re-running their tests (like the papers on AIs performance in medicine & law). Advantages:
1) Helps us understand the variance among GPT-4 class models
2) Helps us understand if there are universal LLM shortcomings
LLMS
-
Academics Should Re-test LLM Performance Across Domains
By
–
-
OpenAI Expands Fine-Tuning API and Custom Models Program
By
–
OpenAI introduced new fine-tuning API features and is expanding its Custom Models Program. The new features will give developers much more control and support for building AI systems for specific use cases.
-
Octopus v2: On-Device AI Agents Surpass GPT-4 Accuracy
By
–
Stanford researchers just introduced Octopus v2, a groundbreaking new framework for on-device AI agents. It outperforms GPT-4 in accuracy by fine-tuning language models with special functional tokens. The new era of on-device AI agents is coming. https://
x.com/nexa4ai/status
/1775993692509323582/video/1
… -
LLM Bias Audit Framework Reveals Popular Model Disparities
By
–
HAI Associate Director @JulianNyarko
’s latest paper examines biases in some of the most popular large language models using an audit design framework. Here he explains what the findings are: -
GPT-4 vs ChatGPT: AI Chatbot Comparison Analysis
By
–
GPT-4 vs. ChatGPT: #AI Chatbot Comparison
by Drew Robb @eWEEKNews Read more: https://
buff.ly/3zXvDl9 #MachineLearning #ArtificialIntelligence #ML #MI #DataScience #Chatbots cc: @pascal_bornet @pbalakrishnarao @rtehrani -
Claude 3 Models Now Support Over 1 Million Token Inputs
By
–
Not as a public feature yet "However, all three models are capable of accepting inputs exceeding 1 million tokens and we may make this available to select customers who need enhanced processing power." https://
anthropic.com/news/claude-3-
family
… -
GPT-4 LLM Agents Spontaneously Collude on Pricing
By
–
New paper finds GPT-4 is very good at pricing, acting as an agent to get a merchant the best price. In fact, it is a little too good. When it is possible to establish an oligarchy, LLM agents spontaneously collude on pricing to the detriment of customers! https://
arxiv.org/abs/2404.00806 -
Cohere’s Multilingual LLM Efforts Enhance AI Inclusivity
By
–
I’m a huge fan of LLM efforts that emphasise multilingualism because they make AI far more inclusive and accessible. Congratulations @cohere
-
How OpenAI Fine-Tunes LLMs Into Assistant Models
By
–
My best slightly educated guess: – LLMs (base models) don’t naturally speak this way. We know this. They’re effectively a mirror of the internet, and therefore write very differently from this.
– When OpenAI started fine-tuning their LLMs into Assistant models, they likely had a -
Claude 3 Tool Calling and Structured Output in TypeScript
By
–
@AnthropicAI Tool Calling in TypeScript Tool calling and `withStructuredOutput` with Anthropic's state-of-the-art Claude 3 models is also supported in JS/TS with the same API as Python! You can use structured output in any of your apps, with the same API schema, just