Generating Benchmarks for Factuality Evaluation of Language Models paper page: https://
huggingface.co/papers/2307.06
908
… Before deploying a language model (LM) within a given domain, it is important to measure its tendency to generate factually incorrect information in that domain. Existing
LLMS
-

Generating Benchmarks for Factuality Evaluation of Language Models
By
–
-

Distilling Large Language Models for Biomedical Knowledge Extraction
By
–
Distilling Large Language Models for Biomedical Knowledge Extraction: A Case Study on Adverse Drug Events paper page: https://
huggingface.co/papers/2307.06
439
… Large language models (LLMs), such as GPT-4, have demonstrated remarkable capabilities across a wide range of tasks, including health -
Rodney Brooks Praises Melanie Mitchell’s Clear Analysis of LLMs
By
–
Melanie Mitchell @MelMitchell1 is always incisive in her evaluations of AI, and more generally ALIFE, and the significance of new results and papers. Here she talks about today's LLMs in the clearest way that I have seen. Bravo! https://
science.org/doi/10.1126/sc
ience.adj5957
… -
Anthropic Launches Researcher Access Program for Claude 2 API
By
–
We are excited to support research into safety and societal impacts via our Researcher Access Program. We aim to provide subsidized API access to our frontier models, including Claude 2, to as many researchers and academics as we can.
-

Symbol Tuning: Improving In-Context Learning with Arbitrary Symbols
By
–
Today on the blog, read all about symbol tuning, a method that fine-tunes models on tasks where natural language labels are replaced with arbitrary symbols. Learn how symbol tuning can improve in-context learning for benefits across various settings →
https://
goo.gle/3rt3r8U -

Mode Collapse in Large Language Models: Book Output Example
By
–
Here’s actual example of mode collapse in an LLM, where “book” is repeatedly outputted.
-
Mode Collapse in LLMs: Understanding Model Degradation
By
–
This is an example of mode collapse—which it turns out happens in LLMs as well (and we discuss in the paper)!
-
Getting Started with ChatGPT: A Guide to Large Language Models
By
–
Side note: If you’ve never you’ve never interacted with a large language model, try playing with ChatGPT: https://
chat.openai.com -

LLMs Generate Synthetic Data: New Research Released
By
–
As part of my takeover, I’ll (
@aspenkhopkins
) be covering some recent work. We released this project today on large language models’ (LLMs) ability to generate synthetic data -
Changing Opinion After Reading a Research Paper
By
–
No I first was and then I wasn’t when I saw that paper and all the congrats in the replies . (How do we expect LLMs to ever solve text comprehension)