Where to start? Analyzing the potential value of intermediate models. By finetuning a model on a source dataset, one may have a better starting point when finetuning a target dataset. @LChoshen
, Elad Venezian, Shachar Don-Yehia, @NoamSlonim
, @YoavKatz
LLMS
-
Intermediate Models Value Through Transfer Learning Fine-tuning
By
–
-
LLMs Struggle Learning Long-Tail Knowledge From Training Data
By
–
Large Language Models Struggle to Learn Long-Tail Knowledge. @kandpal_nikhil
, @HaikangDeng
, Adam Roberts, @Eric_Wallace_
, @ColinRaffel examine the relationship between their pre-training datasets and their knowledge memorized. -
Top NLP Research Papers November 2022
By
–
If you work in #NLP, it's important to keep up to date with the latest research. In this post, we look at some of the top papers on NLP that were published in November 2022 https://
txt.cohere.ai/top-nlp-papers
-november-2022/
… -
Configurable AI Models and Safety Mode Control Options
By
–
i think it’s very reasonable for “default models” to be inoffensive, but within some pretty bounds i think people should be able to configure the models to behave how they’d like, eg like turning off safe mode
-
Fine-tuned Models Producing Poor Results: Data Quality Issues
By
–
but the results from the fine-tuned models were trash and the responses I was getting were really bad I am assuming it takes either significantly more refined prompt/completion data than what I gave it or just more data (both could be true)
-
Initial Fine-Tuning Approach: Breaking Books into Chunks and Generating Questions
By
–
initial approach: oh this seems not too bad, I read this doc https://
beta.openai.com/docs/guides/fi
ne-tuning
… and was like yeah I can just break up the authors' books into chunks and generate some simple questions for each chunk and then use that to fine-tune the model -
Philosophy Author Chatbot Project Using GPT-3 Fine-Tuning
By
–
philosophy author chatbot thing w gpt background: need to create something for my philosophy of AI class idea: fine-tune gpt3 models on text from authors we have read in class and create a chat application where users can talk to these models
-
Philosophy Author Chatbot Project Using Fine-tuned GPT-3 Models
By
–
philosophy author chatbot thing w gpt background: need to create something for my philosophy of AI class idea: fine-tune gpt3 models on text from authors we have read in class and create a chat application where users can talk to these models
-
Stanford and Google Improve Transformer Training with Convex Analysis
By
–
Stanford U & Google’s Convex Analytic Training Framework Improves the Understanding and Optimization of Transformers https://
syncedreview.com/2022/12/01/sta
nford-u-googles-convex-analytic-training-framework-improves-the-understanding-and-optimization-of-transformers/
… -
MIT Scientists Use GPT-3 LLM for Clinical Natural Language Processing
By
–
Scientists at @MIT_CSAIL have used a GPT-3-style large language model (LLM) to perform tasks such as drug regimen extraction – an approach that will transform clinical natural language processing. Code > https://
bit.ly/3OK3CEd via @antgrasso #NLP #gpt3 #AI