Patterns for Building LLM-based Systems & Products https://
bit.ly/45CdmrF
#AI #MachineLearning #DeepLearning #LLMs #DataScience
GENERATIVE AI
-

Patterns for Building LLM-based Systems and Products
By
–
-
Learning Orthogonalized Matrices vs Computing Refusal Directions
By
–
I'd say it's different because you learn the orthogonalized matrix with OFT while you compute (you don't learn) your refusal direction here
-
Model Weight Redaction Techniques in AI Systems
By
–
Yes it's kind of redacting the model's weights in a way
-
OpenAI Launches ChatGPT Voice Mode After Safety Delays
By
–
In June, I reported that OpenAI delayed the launch of its new voice mode for ChatGPT to address safety issues; at the time, it said it would arrive in a month. Today @sama posted it'll drop next week (for a limited group of paid users). https://
bloomberg.com/news/articles/
2024-06-25/openai-delays-launch-of-voice-assistant-to-address-safety-issues?srnd=undefined
… -
Google Integrates AlphaProof and AlphaGeometry into Gemini Models
By
–
We have long pioneered the use of these types of neuro-symbolic systems starting with AlphaGo in 2016, through to AlphaZero. We'll be bringing all the goodness of AlphaProof and AlphaGeometry 2 to our mainstream #Gemini models very soon. Watch this space!
-
OpenAI clarifies OAI-SearchBot functionality and data usage policy
By
–
Bing but also with an LLM on top. "OAI-SearchBot is for search. OAI-SearchBot is used to link to and surface websites in search results in the SearchGPT prototype. It is not used to crawl content to train OpenAI’s generative AI foundation models." https://
platform.openai.com/docs/bots -

Gemini Language Reasoning System Tackles IMO Mathematics Problems
By
–
Last but not least, we experimented with a Gemini-based language reasoning system that showed great promise at this year’s IMO problems. This system doesn’t require the problems to be translated into a formal language and can directly generate and verify solutions in
-

Privacy and Operational Details for SearchGPT Prototype
By
–
More statements from the onboarding page
– It is a WIP prototype
– It may collect your location info
– Your search queries might be reviewed – Account history for SearchGPT is separate from ChatGPT -

SearchGPT offers real-time information with initial US-only availability
By
–

BREAKING: SearchGPT is promising to be good with real-time information It seems like it will be available in the US initially (and not in the EU obviously)
-
Copyright Traps Paper Enhances Membership Inference Attacks Detection
By
–
Quoted in nice article by @Melissahei
, on a #ICML2024 paper on "copyright traps" by @matthieu_meeus @ffuuugor @ManuelFaysse @yvesalexandre Cool idea to enhance the efficacy of membership inference attacks to detect copyrighted data. Caution tho: similar to Glaze, not futureproof