Improving Instruction Tuning for LLMs: Meta AI Presents the OPT-IML Benchmark of 2000 NLP Tasks
LLMS
-
Chain-of-Thought Prompting Demo on Poe Chatbots
By
–
Another demo — chain-of-thought prompting on Poe (“Dragonfly” — there’s multiple chatbots) using the “format trick”: https://
poe.quora.com/s/Tycgjooa3Aio
SfOfLZsN
… -
New AI Chat Interface Offers Natural Speech and Reduced Latency
By
–
Okay, I’m cleared to say more. It’s like ChatGPT, but the speech is more natural and terse, like texting. Much better latency (hope it lasts). Social sharing good enough to replace sharing screenshots on Twitter. Here’s me talking to Poe: https://
poe.quora.com/s/YPMAqBPuDShG
g3kl1mbt
… -
Prompt Engineering Remains, But Five New More Valuable Things Will Emerge
By
–
prompt eng will always be "a thing" but this time next year we'll have found 5 more new "things" that are more valuable to build on
-
AI Model Conditioning: Prompting vs. Fine-Tuning Techniques
By
–
Generally I’d call that “conditioning the model”, which can take the form of either prompting or fine-tuning, but not sure if that’s exactly the right term. They’re two different techniques to make it respond how you want.
-
Fine-tuning for AI Specialization and Performance
By
–
Not sure I understand fully re: alignment, but fine-tuning is usually the most performant way to specialize when you have the data for it.
-
Parameter Count Alone Cannot Measure LLM Quality
By
–
Comparing LLMs by param count is like comparing
– CPUs by megahertz in the 1990s
– cameras by megapixel in the 2000s
– phones by memory in the 2010s A primitive reductionism – true enough, but maxes out Then we pivot to fit-for-purpose measures.. That lead to enduring brands. -
GPT-3 Inference Non-Determinism at Temperature Zero Explained
By
–
An edge-case in GPT-3 with big implications: Inference is non-deterministic (even at temperature=0) when top-2 token probabilities are <1% different. So temperature=0 output is *very close* to deterministic, but actually isn't. Worth remembering.
-
The unique expertise of a Staff Prompt Engineer in LLMs
By
–
My goal is to do my job so well that I'm not just the first Staff Prompt Engineer, but the last. Most people don't have the time to learn what LLMs have taught me.
-
AI Today Podcast: Content Summarization and Sentiment Analysis Episode
By
–
In this @Cognilytica #AIToday #podcast episode 'Content Summarization and Analysis, Sentiment Analysis' from the AI Glossary Series, hosts @rschmelzer & @kath0134 define Content Summarization and #Analysis and #sentimentanalysis. Full episode: https://
cognilytica.com/2022/12/28/ai-
today-podcast-ai-glossary-series-content-summarization-and-analysis-sentiment-analysis/?utm_source=dlvr.it&utm_medium=twitter
…
#AI #nlp #ML