A new class action lawsuit filed against OpenAI yesterday takes aim at the company using public online content to train its LLMs. The suit alleges OpenAI violated copyright and privacy laws by scraping data from social media, blog posts, articles and various other sources.
GENERATIVE AI
-
OpenAI Training Data Transparency: Copyright, Bias, and Generalization Issues
By
–
Agreeing and extending @sashamtl
, there are lots of reasons why OpenAI likely isn’t open about training data: copyright, bias, and also questions about generalization & data contamination. I too salute @abebab
’s great detective work, including an important new paper coming soon. -
Inflection AI’s Model Runs on Massive Computing Cluster with CoreWeave
By
–
Our model runs on a system built with our partner @CoreWeave
, which is one of the largest computing clusters in the world, comprising 22,000 @NVIDIA H100 Tensor Core GPUs. -
Inflection AI Launches Sophisticated LLM for Pi Product
By
–
Our team has developed one of the most sophisticated LLMs in the market. The model enables people to interact with our first product, Pi, in the most simple, natural way, to receive fast, relevant, and helpful information and advice.
-
Large Language Models Overview and Enterprise Applications
By
–
An excellent overview of Large Language Models, LLMs, & what are they used for from @nvidia @NVIDIAAI : https://
blogs.nvidia.com/blog/2023/01/2
6/what-are-large-language-models-used-for/
… LLMs are making Artificial Intelligence more accessible to the end user & have placed AI on the radar of many CEOs. They have even been embedded into -
AutoGPT: Self-Iterating AI Agents with GPT-3.5 and GPT-4
By
–
AutoGPT combines GPT-3.5 and GPT-4 via API, allowing projects to be created that have been iterating on their own prompts and reviewing each iteration to improve and build upon it. AutoGPT: Everything You Need To Know – KDnuggets https://
bit.ly/43Z1f7X -
Inflection AI raises $1.3B for massive AI cluster and Pi
By
–
Excited to announce that we’ve raised $1.3B to build one of the largest clusters in the world and turbocharge the creation of Pi, your personal AI. https://
forbes.com/sites/alexkonr
ad/2023/06/28/inflection-ai-raises-1-billion-for-chatbot-pi/
… -
LoRA Weight Matrix Factorization During Fine-tuning Explained
By
–
You mean as in LoRA (low-rank adaptation)? You are factorizing the weight matrices but only during finetuning. The self-attention mechanism computation is still the same (if you ignore that the weight matrices are different).
-
Multi-query attention experiences revival with Falcon model
By
–
Also, multi-query attention has a little comeback (thanks to Falcon)
-
Reasons Behind OpenAI Models’ Superior Performance Remain Unknown
By
–
Yeah. And we still don't know why OpenAI models are better: 1. More and better data?
2. Larger pretrained base model?
3. RLHF instead of supervised finetuning? My guess is it's probably all of these above.