8/ Summary of ChatGPT/GPT-4 Research – an overview of applications of ChatGPT and GPT-4; the analysis is done on 194 relevant papers and discusses capabilities, limitations, concerns, and more.
LLMS
-
Baize: Open-Source Chat Model Fine-Tuned with LoRA
By
–
5/ Baize – an open-source chat model fine-tuned with LoRA. Leverages 100K dialogs generated from ChatGPT chatting with itself; it releases the dialogs along with 7B, 13B, and 30B parameter models.
-
Machiavelli Benchmark: Evaluating LLM Ethics in Adventure Games
By
–
6/ Machiavelli Benchmark – a new benchmark of 134 text-based Choose-Your-Own-Adventure games to evaluate the capabilities and unethical behaviors of LLMs.
-
Eight Things to Know about LLMs: Capabilities and Limitations
By
–
3/ Eight Things to Know about LLMs – discusses important considerations regarding the capabilities and limitations of LLMs.
-
New 50-Page Survey on Large Language Models Released
By
–
4/ A Survey of LLMs – a new 50 pages survey on large language models.
-
Top ML Papers Week April 3-9 Segment Anything Model
By
–
Top ML Papers of the Week (April 3 – 9): – Segment Anything Model
– SegGPT
– A Survey of LLMs
– Instruction Tuning with GPT-4
– 8 Things to Know about LLMs
– Summary of ChatGPT/GPT-4 Research
… -
GPT-4 Instruction Tuning Dataset for LLaMA Models
By
–
2/ Instruction Tuning with GPT-4 – a "first attempt" to use GPT-4 to generate instruction-following data for LLM fine-tuning; includes 52K unique English & Chinese instruction-following data used to instruction-tune LLaMA models.
-
GPT-4 excels as SQL JavaScript Python coding assistant
By
–
#GPT4 is the best #SQL/#JS/#Python writing assistant I've ever used
-
Solving Low-Frequency Language Understanding in AI Models
By
–
well, could be, but a lot of people told me a year ago it was *already* solved. and i wondered then/continue to wonder with low frequency/novel words, unusual phrases, etc.
-
Self-Attention Mechanism in Transformer Models for LLMs
By
–
Nice overview of self-attention mechanism used in Transformer models that underpin many Large Language Models (LLMs) & members of the GPT family.