We’re also actively hiring research engineers/scientists to work with us on interpretability. If you’re interested, we’d encourage you to apply!
Research engineer: https://
jobs.lever.co/Anthropic/436c
a148-6440-460f-b2a2-3334d9b142a5
…
Research scientist: https://
jobs.lever.co/Anthropic/eb9e
6d83-626c-4f59-8a0e-fa7c413b2014
…
INNOVATION
-
Anthropic Hiring Research Engineers and Scientists for Interpretability
By
–
-
Thanks to Adam S Jermyn for reproducing and extending results
By
–
Thanks to @AdamSJermyn for his comments reproducing and extending these results! https://
transformer-circuits.pub/2023/toy-doubl
e-descent/index.html#comment-jermyn-1
… -
Superposition in Neural Networks: Memorization vs Feature Learning
By
–
For small training sets, models use superposition to memorize more data points than the two available neurons. For large training sets, models learn features in superposition, as observed in our previous work, allowing the model to generalize. https://
transformer-circuits.pub/2022/toy_model
/index.html
… -
Understanding Deep Learning Overfitting Through Mechanistic Analysis
By
–
We have little mechanistic understanding of how deep learning models overfit to their training data, despite it being a central problem. Here we extend our previous work on toy models to shed light on how models generalize beyond their training data. https://
transformer-circuits.pub/2023/toy-doubl
e-descent/index.html
… -
Superposition Strategy: How Neural Networks Embed Features in Hidden Space
By
–
Our prior work showed that these toy models use a strategy called “superposition” to learn more features than available neurons. Here we observe how training data points, as well as features, are embedded in the hidden space.
-
GroqWare Suite: Foundation of Software-Defined Hardware Approach
By
–
The foundation of our software-defined hardware approach is the GroqWare™ suite. Learn about our product offerings here: https://
groq.link/groqware -
LLMs Will Get Better This Year, Solving Trivial Problems
By
–
Prototypes are easy, production is hard. However, LLMs will get a **lot** better this year. Expect many unsolved problems to become trivial. But not all.
-
Unified Communications AI Productivity Hybrid Workers Equality
By
–
Diary Date 🙂 Join @Mitel #CMO @VenkatNagaswamy & I for #LinkedIn #LiveStream on #tech & #people aspects of #UnifiedCommunications – Ensuring #equality of #Productivity for #Hybrid workers Jan 12th http://
bit.ly/CommsUnified #telco #5G #AI #MitelPartner #CES2023 #innovation -
LifeOxa Wearable Shirt Sensor Guides Focus and Calm
By
–
@LifeOxa is a sensor built into your t-shirt that measures your breathing. It is the first wearable that guides you into a state of focus and calm, avoiding stress and other health issues We are at CES 2023! Visit us at booth #61433 to try Oxa #Oxa #ces2023 #health #sleep
-
The Joy of Shipping Code and Impacting Real Users
By
–
Writing code for is not very fun for its own sake. What makes it insanely addictive is the feeling upon shipping — that actual people are doing something useful with what started as a figment of your imagination. Never gets old.