We ask non-experts to answer expert-level questions on MMLU, and also ask people to answer questions about long QuALITY passages under a time limit that’s too short for a careful read.
RESEARCH
-
Scalable Oversight Framework and Language Model Question-Answering Proof of Concept
By
–
Along with developing a framework for scalable oversight, we also conduct a proof of concept experiment that demonstrates a couple of question-answering tasks that work well under this paradigm with current language models:
-
Challenges in Studying Model Assistance: Task Selection and Experimental Design
By
–
It’s also challenging to study: For most tasks today, we don’t actually need our model’s help in this way. So testing these methods will require us to be clever about how we choose our tasks and design our experiments.
-
Scalable Oversight: Supervising AI Systems Beyond Human Capabilities
By
–
To ensure that AI systems remain safe as they start to exceed human capabilities, we’ll need to develop techniques for scalable oversight: the problem of supervising systems’ behavior without assuming that the overseer understands the task better than the system being trained.
-
AI Systems Improving Human Oversight of Large Language Models
By
–
In "Measuring Progress on Scalable Oversight for Large Language Models” we show how humans could use AI systems to better oversee other AI systems, and demonstrate some proof-of-concept results where a language model improves human performance at a task.
-
Favorite Book on Extraterrestrial Life and Universe Exploration
By
–
Yes. My favorite book on the problem. https://
amazon.com/Universe-Teemi
ng-Aliens-WHERE-EVERYBODY/dp/3319132350/ref=nodl_?dplnkId=73876c48-56c0-4448-b18f-654dcd55039d
… -
Sanofi Signs Billion-Dollar AI Drug Discovery Deal with InSilico
By
–
An over billion deal marking the revolution of AI-empowered new drug discovery. Congrats to @InSilicoMeds @biogerontology on this milestone with Sanofi. https://
venturebeat.com/ai/sanofi-sign
s-latest-billion-dollar-ai-drug-discovery-deal-this-time-with-insilico/amp/
… -
How Much Does Attention Actually Attend in Transformers?
By
–
How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers Hassid et al.: https://
arxiv.org/abs/2211.03495 #ArtificialIntelligence #DeepLearning #MachineLearning -
Can AI-Generated Art Replace Creative Humans?
By
–
Can AI-Generated Art Replace Creative Humans? https://
vice.com/en/article/epz
kwm/artificial-intelligence-art-creatives-ai
… @VICE #AI #DeepLearning #MachineLearning #BigData #Analytics #Robots #100DaysofCode #IoT #serverless #DEVCommunity #womenwhocode #DigitalTransformation #ArtificialIntelligence #Python #DataScience -
AudioGen: Meta’s Revolutionary Text-to-Audio AI Model
By
–
AudioGen, Meta AI's text-to-audio AI model https://actuia.com/actualite/audiogen-le-modele-dia-text-to-audio-de-meta-ai/
… #AI #artificialintelligence #audio