1/Large language models like Galactica and ChatGPT can spout nonsense in a confident, authoritative tone. This overconfidence – which reflects the data they’re trained on – makes them more likely to mislead.
GENERATIVE AI
-
WordfixerBot: Free AI Grammar and Text Processing Tool
By
–
WordfixerBot by @austinnguyen00 is a free AI tool that checks your grammar and paraphrases, summarizes, and compares text. https://
futurepedia.io/tool/wordfixer
bot
… #productivity #Researcher #ArtificialIntelligence -
Key AI Benchmarks for Language Model Evaluation
By
–
Benchmarks:
– MMLU (massively multitask language understanding): https://
arxiv.org/abs/2009.03300
– BBH (Big-Bench Hard): https://
arxiv.org/abs/2210.09261
– TyDiQA (typographically diverse QA): https://
arxiv.org/abs/2003.05002
– MGSM (multilingual grade school math): https://
arxiv.org/abs/2210.03057 -
Code-Davinci-2 vs Text-Davinci-3: Instruction Tuning and PPO Performance
By
–
– code-davinci-2 > text-davinci-3 means that their instruction finetuning overall hurts performance on academic benchmarks
– text-davinci-3 > text-davinci-2 means that PPO improves performance -
Text-davinci-003 Instruction Following vs Academic Benchmark Performance
By
–
@OpenAI
's text-davinci-003 follows instructions better. Is it also better on academic benchmarks? Summary:
– text-davinci-3 beats text-davinci-2, but is not as good as code-davinci-2
– it is behind @GoogleAI
's PaLM and Flan-U-PaLM Full results: https://
arxiv.org/abs/2210.11416 App D -
LangChain v0.0.36 Release with Python 3.11 and LLM Improvements
By
–
LangChain v0.0.36: Adding Python 3.11 to Testing – cclaus
Doc improvements – @BruceHammer @ankush_gola11 Unit test/code coverage – @HunterGerlach Base LLM improvements – @thepromptking @0xAwill
LLM serialization – @AkashSamant4 Keep an out for on LLM improvements -
International dark web AI model training despite regulation challenges
By
–
Yes, and international / dark web models can still be trained. It’ll be a mess.
-
MAGVIT: Masked Generative Video Transformer Explained
By
–
MAGVIT: Masked Generative Transformer Yu et al.: https://
arxiv.org/abs/2212.05199 #Artificialintelligence #DeepLearning #Machinelearning -
ChatGPT as a Partial Stack Overflow Replacement
By
–
it is not a 100% replacement for stackoverflow, but it is at least a 50-80% replacement and that is AWESOME
-
Building Companies and Pioneering Research in Generative AI
By
–
If you are building a company, pioneering research or thinking about Generative AI too – let me know. I would love to speak to you.