We ask non-experts to answer expert-level questions on MMLU, and also ask people to answer questions about long QuALITY passages under a time limit that’s too short for a careful read.
MACHINE LEARNING
-
Scalable Oversight Framework and Language Model Question-Answering Proof of Concept
By
–
Along with developing a framework for scalable oversight, we also conduct a proof of concept experiment that demonstrates a couple of question-answering tasks that work well under this paradigm with current language models:
-
Challenges in Studying Model Assistance: Task Selection and Experimental Design
By
–
It’s also challenging to study: For most tasks today, we don’t actually need our model’s help in this way. So testing these methods will require us to be clever about how we choose our tasks and design our experiments.
-
AI Systems Improving Human Oversight of Large Language Models
By
–
In "Measuring Progress on Scalable Oversight for Large Language Models” we show how humans could use AI systems to better oversee other AI systems, and demonstrate some proof-of-concept results where a language model improves human performance at a task.
-
Transfer Learning for Medical Imaging and X-Ray Diagnosis with AI
By
–
It's World Radiography Day Radiographs have come a long way since its inception. Today with the help of AI, medical diagnosis has had a lot of innovations. Transfer Learning is one such innovation that finds use in medical imaging like X-Rays. https://
learnopencv.com/transfer-learn
ing-for-medical-images/
… #xray #ai -
YOLOv7 Pose: Single-Stage Multi-Person Keypoint Detection
By
–
Unlike conventional Pose Estimation algorithms, YOLOv7 pose is a single-stage multi-person keypoint detector. It is similar to the bottom-up approach but heatmap free. It is an extension of the one-shot pose detector – YOLO-Pose. https://
learnopencv.com/yolov7-pose-vs
-mediapipe-in-human-pose-estimation/
…
#yolov7 #poseestimation -
Smaller Models with Better Data Can Outperform Larger Ones
By
–
Great point. We are seeing more and more than smaller models with better objectives or data can beat big ones! My main point is that an approach shouldnt go away as models get better. Scale is just one way of getting better
-
Deep Learning’s Future: A 2009 NeurIPS Prediction Recalled
By
–
13 years ago at Neurips 2009, 3 years before AlexNet, a young student @ilyasut explaining to my dinner table why Deep Learning is gonna be the future.
Looking forward to #NeurIPS2022. -
Machine Learning and Analytics in Professional Soccer Predictions
By
–
When you think of soccer, do machine learning and analytics come to mind? They should! Learn how pros make their uncanny predictions. Sign up: http://
ow.ly/yCVt50Lv5HB #MachineLearning #analytics -
Progress in Model Training: From Full Dataset Collection to Modern Approaches
By
–
Definitely a limitation. I see some
progress, though. Back in the day, we had to collect an entire training dataset and train a new model!