yes, the scaling law, be it the chinchilla or Kaplan ones, are not at all a prediction/measure of the capacity of a model -in retrospect if you take a system-wide approach, with deployment/finetuning in consideration, they probably matter a lot less than people think
@thom_wolf
-
Aligning Powerful AIs in Open-Source World
By
–
I predict the same long term trend for AI – sharing is such a deep human trait & this lead me to the 2nd –even more important–thread I need to write which is: *how do we align powerful AIs in an open-source world* but this one is for another day 🙂 8/N
-
Open-source renaissance: Microsoft’s pivot to Linux advocacy
By
–
Well mostly… open-source… as a phoenix rising from the ashes A flurry of open-source softwares and communities up to the point that Microsoft it-self pivoted to become the linux-based open-source software advocate that we now today. 7/8
-
AI Dominance and Antitrust: Learning from Tech’s Past
By
–
Today's AI technology is even more ground breaking than the 2000's revolution. A future strongly dominated by a single actor in business domain will likely bring similar gigantic billion dollars antitrust actions. And… what emerged from the ashes of the 2000's battles? 6/8
-
OpenAI Microsoft Integration Could Achieve Market Dominance
By
–
Now let's move to today. We'll replace IBM with the Microsoft of today (the leading enterprise platform) and the early Microsoft with OpenAI (the closed source AI model provider) OAI models smartly integrated in Microsoft suit could reach a similar level of market dominance 4/8
-
Microsoft Dominance and Antitrust Lawsuits: Historical Market Lessons
By
–
A good exemple is the recent alliance with Bain for extending everywhere in large companies Now back to 2000 what did this dominance led to: you probably remember it as several of the largest anti-trust lawsuits ever reaching several billion $ at that time for Microsoft 5/8
-
Microsoft’s Early 2000s Battle Against Open Source Movement
By
–
let's go back to early 2000 – Microsoft was at that time the archenemy of the free and open source movements and the fight between OSS and private software was going strong 2/8
-
AI industry faces massive antitrust legal spending surge
By
–
Ok friends, it's weekend, we've some time for us. So let me tell you about a possible future for AI where the largest AI spendings, in billions of dollars, in 2-3 years would be on… … antitrust legal fees A quick 1/8
-
10B Parameter Models Vastly Underestimated in Capacity
By
–
It's increasingly clear we've severely underestimated how much you can pack in a 10B parameters model
-
Julien highlights AWS Cloud partnership
By
–
Great words from Julien on our partnership with @awscloud