thankful twitter hasn't implemented a peer review process yet unlike latent diffusion, in this case the embedding space is fixed (it's openAI ada 2 in my notebook) I think this is kind of like conditional generation
MACHINE LEARNING
-
GPU-Powered AI Models Combat Financial Fraud and Identity Theft
By
–
The digital landscape is plagued with identity theft, credit card fraud and other schemes. GPU-powered #AI, #datascience and #machinelearning models are helping counter these problems in #financialservices. Read more here. #frauddetection
-
SambaNova Sponsors NeurIPS 2023 Instruction Tuning Workshop
By
–
.
@SambaNovaAI is a proud sponsor of the ITIF "Instruction Tuning and Instruction Following" workshop at #NeurIPS2023! The workshop will cover exciting research in ITIF and evaluation of instruction tuned models. The workshop features invited talks, peer reviewed papers, and a -
GBDTs Training Optimization: Learning Rate Effects on Tabular Data
By
–
Maybe, but even for pretty large models training time for GBDTs is so low that it might not be a major issue. I also think that due to “jagged” nature of tabular data manifolds, using longer lr initially might be detrimental to finding the global optimum.
-
Probabilistic Models and Text Embeddings: Learning p(e)
By
–
for sure, the probabilistic breakdown is the same: given text sequence x and its embedding e, p(x) = p(x | e) p(e). this looks a lot like a latent variable model with latent embedding e in my case p(x | e) is done by vec2text with openAI embeddings; we just need to learn p(e)
-
RLHF and RLAIF: Training Techniques Revolutionizing Language Models
By
–
Discover the magic behind ChatGPT's effectiveness in our deep dive into RLHF and its innovative counterpart, RLAIF. Learn how these training techniques are revolutionizing language models, making them safer, smarter, and more efficient.
-
Reinforcement Learning from Human Feedback Explained and RLAIF
By
–
Reinforcement Learning from Human Feedback Explained (and RLAIF) Learn more: https://
youtu.be/_66Qp_xZ8Fw The video was made for the LLM course with @activeloop and @towards_AI
. More details in the comments! -
Language Model Fine-Tuning in Embedding Space
By
–
fun idea I tested out this morning: Language model fine-tuning in embedding space here's the idea: learn a model of *embeddings* of a certain text distribution; then, to generate text, sample embedding and map back to text with vec2text this lets us generate language without
-
Word2Vec: The Game-Changing Natural Language Processing Breakthrough
By
–
A super banger paper. Word2Vec has been such a game changer.
-
Jelani Nelson on Data Sketches at NeurIPS 2023
By
–
This morning’s #NeurIPS2023 Keynote talk is by Jelani Nelson, who will discuss data sketches (memory-compressed summarizations for answering of useful queries), core sketching tools & how they work, and new areas of related research. The talk starts at 8:30am!