7/ Fine-Grained RLHF – trains LMs with fine-grained human feedback; instead of using overall preference, more explicit feedback is provided at the segment level which helps to improve efficacy on long-form question answering and reduces toxicity.
RESEARCH
-
AlphaDev Discovers Faster Sorting Algorithms via Reinforcement Learning
By
–
2/ AlphaDev – a deep reinforcement learning agent which discovers faster sorting algorithms from scratch; the algorithms outperform previously known human benchmarks and have been integrated into the LLVM C++ library.
-
Sparse-Quantized Representation enables 4.75-bit LLM inference
By
–
3/ Sparse-Quantized Representation – a new compressed format and quantization technique that enables near-lossless compression of LLMs across model scales; “allows LLM inference at 4.75 bits with a 15% speedup”.
-
Dense Motion Estimation Method Tracks Pixels Across Full Videos
By
–
1/ Tracking Everything Everywhere All at Once – propose a test-time optimization method for estimating dense and long-range motion; enables accurate, full-length motion estimation of every pixel in a video.https://t.co/7O3Z0Em7wE
— DAIR.AI (@dair_ai) 11 juin 20231/ Tracking Everything Everywhere All at Once – propose a test-time optimization method for estimating dense and long-range motion; enables accurate, full-length motion estimation of every pixel in a video.
-
Top ML Papers Week: AlphaDev, MusicGen, RLHF Advances
By
–
Top ML Papers of the Week (June 5-11): – AlphaDev
– MusicGen
– Fine-Grained RLHF
– Humor in ChatGPT
– Concept Scrubbing in LLM
– Augmenting LLMs with Databases
… -
Detecting AI-Generated Content and Deepfakes for Digital Security
By
–
In the era of #AI-produced #content, from written pieces to #deepfake videos, understanding how to detect such creations is key to maintaining truth, integrity, and #security in our increasingly #digitized society. https://
linkedin.com/pulse/how-can-
you-detect-content-created-chatgpt-other-ais-bernard-marr
… -
System Converting LLM Output into Checkable Queries
By
–
Sure, a system that could systematically and reliably turn LLM output (or other text) into checkable queries like that would be useful.
-
Fine-tuning SD and LLaMA: compute, data, use cases matter most
By
–
It’s trivial to build a fine tune on top of SD/LLaMA these days. Access to compute, access to data, and a kick ass use case are the hardest parts.
-
MusicGen, BAAI LLM, LIMA Dataset, Llama Falcon Variants
By
–
MusicGen, BAAI’s new LLM, LIMA dataset launch, a billion new variants of Llama/ Falcon & much more.
— Vaibhav (VB) Srivastav (@reach_vb) 11 juin 2023
You were missed hehe! 🤗 pic.twitter.com/rg2mF0hk7UMusicGen, BAAI’s new LLM, LIMA dataset launch, a billion new variants of Llama/ Falcon & much more. You were missed hehe!
-
Essential Math Skills Foundation for Data Science Success
By
–
Mastering essential math skills is crucial for success in data science. From linear algebra to statistics, these concepts are the foundation for understanding and analyzing data. Via @ingliguori #datascience #math #learning #bigdata #DataAnalytics #DataScientist #MachineLearning