We need new technical breakthroughs to steer and control AI systems much smarter than us. Our new Superalignment team aims to solve this problem within 4 years, and we’re dedicating 20% of the compute we've secured to date towards this problem. Join us!
RESEARCH
-
New Alignment Team Leadership and Members Announced
By
–
@ilyasut (co-founder and Chief Scientist) will be co-leading the team with @janleike (Head of Alignment).
In addition to members from our existing alignment team, joining are Harri Edwards, @burdayur
, @AdrienLE
, @__nmca__
, @CollinBurns4
, @bobabowen
, @Pavel_Izmailov
, @leopoldasch
. -
Llama.cpp and Activation Checkpointing Optimization Techniques
By
–
yea, llama.cpp is it for the llama-style models.
About activation checkpointing — the way the LLM people do it is to intentionally sidestep autodiff and hand-write a clever backward. Sometimes people even do mathematically approximate stuff. -
Book examines artificial intelligence applications in modern medicine
By
–
Great book looking at what is going on with AI in medicine.
-
Vision System Combines Image Generation and Recognition via Masking
By
–
Vision system marries image generation and recognition by inferring the missing parts of an image. It uses a variable masking strategy during pre-training, helping a neural net fill in the gaps for tasks like editing and learning: https://
bit.ly/3r4QL7Y -
Curated AI Courses and Resources Collection on GitHub
By
–
GitHub – SkalskiP/courses: This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI) https://
bit.ly/43jJ8cB #MachineLearning #AI #DataScience #DeepLearning -
Kjell Carlsson on Specialized LLMs Power at VB Transform
By
–
Kjell Carlsson speaks on the power of #sLLM's over "generic" LLMs at #vbtransform Jul 11. https://
venturebeat.com/ai/a-hot-gener
ative-ai-summer-is-here-get-ready-to-sweat-the-ai-beat/
… -
Six RAG Modules: Deep Dive on Text Splitters and Retrieval
By
–
There are six modules: – Document loaders
– Text splitters
– Embeddings and vector stores
– Retrieval
– QA generation
– Chat We go deep on each one. The three I think are most interesting/insightful: text splitters, retrieval, chat -
How AI Will Transform Search and Content Creation
By
–
How Will AI Change Search And Content Creation?
#AI #AIio #BigData #ML #NLU #Futureofwork http://
ow.ly/ort530svSfn -
Technology as Core Objective in New Cold War
By
–
technology is no longer a tool of foreign policy, it drives it. in the new cold war, dominating technology is actually the core objective