3. How people use language models. Interaction and collaboration with language models will be a new direction similar to HCI, and I’m super excited about application of language models for use cases such as foreign-language learning, training therapists, etc.
INNOVATION
-
Building Evaluations for Frontier Language Models
By
–
2. Building evaluations. Many benchmarks get quickly saturated, and we need more to evaluate the frontier of language models. In addition, it’s still an open question of how to evaluate language models generally. The new OpenAI evals library could be good: https://
github.com/openai/evals -
Prompting Research: Just the Beginning for Language Model Guidance
By
–
1. Prompting research. Maybe hot take, but I think we’ve just reached the tip of the iceberg on the best ways to prompt language models. As language model capabilities increase, the degrees of freedom for guiding a particular generation via a good prompt will increase.
-
Democratized Red Teaming: Building Robust AI Models Through Adversarial Testing
By
–
Democratized red teaming is one reason we deploy these models. Anticipating that over time the stakes will go up a *lot* over time, and having models that are robust to great adversarial pressure will be critical. Also considering starting a bounty program/network of red-teamers!
-

Customized AI Models Drive Enterprise Efficiency and Competitive Advantage
By
–
“Compared with one-size-fits-all-models where your data needs to be shipped off to a third-party API, customized owned models bring huge efficiency savings that give businesses a clear competitive advantage in their lines of work.” – @MarshallChoy https://
techmonitor.ai/technology/ai-
and-automation/microsoft-copilot-for-work-office-365-ai
… -

Microsoft 365 Copilot Launch: Understanding Usefully Wrong
By
–
From Microsoft 365 Copilot launch post one hour ago… What is “usefully wrong”?
-
Sam Altman Interview on GPT-4 ChatGPT and AI
By
–
I'm doing podcast with Sam Altman (
@sama
), CEO of OpenAI next week, about GPT-4, ChatGPT, and AI in general. Let me know if you have any questions/topic suggestions. PS: I'll be in SF area next week. Let me know if there are other folks I should talk to, on and off the mic. -

Congratulations to PyTorch on Major New Release
By
–
Congratulations @PyTorch on this week's big new release!
-

NVIDIA GTC Sessions on AI Business Strategy for Leaders
By
–
Dozens of sessions at @NVIDIAGTC feature NVIDIA and industry luminaries focused on #AI business strategy for leaders. https://
nvda.ws/3TjfCyY #GTC23 -
Ben’s Bites Launches Makers-In-Residence Program for AI Builders
By
–
If you're building with AI – you already know Ben's Bites. Time to join their new Makers-In-Residence program!