Happy to be helpful! Follow along at @alliekmiller for more on artificial intelligence and technology.
AI
-
AI Expert Shares Insights on Technology and Venture Capital
By
–
Thanks for reading this far. I've worked in artificial intelligence for startups and 2 of the 5 largest cloud providers and have been an angel investor in the space for 5+ years. Follow me @alliekmiller for more insights on AI, tech, business, and venture capital.
-
Building Furniture Recognition System with Machine Learning
By
–
Really really really hard problem to solve, need a massive database of furniture objects and then recognize them, I have no idea how to that, tried to learn it but it's very difficult
-
Cerebras CS-2 Python API Achieves 470x Faster Performance
By
–
At #SC22, Dr. Dirk Van Essendelft from the National Energy Technology Laboratory presented a Python API to build applications that run on Cerebras CS-2 systems with impressive results – 470x faster than the Joule supercomputer! Watch his lecture:
-
Anthropic Hiring Research Engineers and Scientists for AI Evaluation
By
–
We’re also actively hiring research engineers/scientists to develop evaluations and to find/fix flaws with LMs/RLHF. If you’re interested, we’d encourage you to apply!
Research engineer: https://
jobs.lever.co/Anthropic/436c
a148-6440-460f-b2a2-3334d9b142a5
…
Research scientist: https://
jobs.lever.co/Anthropic/eb9e
6d83-626c-4f59-8a0e-fa7c413b2014
… -
Language Models Augmenting Evaluation Authors for Faster Assessment
By
–
We’re excited about the potential of LMs to augment evaluation authors, so that they can run more (and larger) evaluations more quickly. We encourage you to read our paper for more results/details: https://
anthropic.com/model-written-
evals.pdf
…
Generated data: -
Interactive Visualizations for Model-Written Dataset Evaluations Released
By
–
To help readers understand our evaluations better, we created interactive visualizations showcasing the diversity of each of the model-written datasets: https://t.co/yc9oP9n9uV pic.twitter.com/R5IH7nTJw4
— Anthropic (@AnthropicAI) 19 décembre 2022To help readers understand our evaluations better, we created interactive visualizations showcasing the diversity of each of the model-written datasets: https://
evals.anthropic.com/model-written/ -

RLHF Training Shows Inverse Scaling Issues in Model Behavior
By
–
We also find some of the first instances of inverse scaling for RL from Human Feedback (RLHF), where more RLHF training makes behavior worse. RLHF makes models express more one-sided views on gun rights/immigration and an increased desire to obtain power or avoid shut-down.
-

Large Language Models More Sycophantic Than Small Ones
By
–
Using these LM-written evals, we found many new instances of "inverse scaling," where larger LMs are worse than smaller ones. For example, larger LMs are more sycophantic, repeating back a user's views as their own in 75-98% of conversations.
-
LM-written data verified by human evaluators for quality
By
–
We verified LM-written data with human evaluators, who agreed with the data’s labels and rated the examples favorably on both diversity and relevance to the tested behavior. We’ve released our evaluations at
