Google keeps falling asleep at the wheel here. It didn’t productize MapReduce, allowing Hadoop to happen. It let PyTorch blossom and take over the DS/DL community. And now it has basically let competitors run off with the Transformers technology.
BIG TECH
-
GPT-4 Architecture: Parameter Count and Competitive Moat Analysis
By
–
OpenAI is mentioned in here as having no moat, but OpenAI was also intentionally silent about the parameter count of GPT-4. I know some people have been flinging around a 1T parameter number for GPT-4 but it’s very possible that it isn’t a single 1T model and instead 1T total.
-
Meta’s LLaMA Leak: Legal Implications and Open Source Adoption
By
–
And you have to appreciate the stance here which is basically like “what is Meta going to do, sue all the people using the leaked LLaMA model?”
-
Meta’s FAIR Outpaces Google in Open Source AI Leadership
By
–
Meta comes out looking so good from this. Meta’s AI division FAIR has consistently outmaneuvered Google in the open source deep learning community, starting with PyTorch and now with LLaMA.
-
LoRA and Quantization: Google Shifts from Big Numbers Approach
By
–
One of my big takeaways is just how important LoRA—basically a way to simplify and reduce the cost re-training models—and quantization for more compact models is here. Google has traditionally taken the Big Numbers approach to model development so it’s at minimum notable.
-
Company Age Comparison: Tech Giants from OpenAI to Nokia
By
–
Companies by age: OpenAI: 8 years Twitter: 17 years Facebook: 19 years Tesla: 20 years Google: 25 years Amazon: 29 years Apple: 47 years Microsoft: 48 years Sony: 77 years IBM: 112 years Nintendo: 134 years Nokia: 158 years v/
@spectatorindex -
AI’s Free Pass: Data Access Before Platform Restrictions
By
–
Now for the actual column, we're talking about how AI basically got a free pass all the way to launching an industry-breaking technology. The platforms where that data comes from are planning on gating it after the fact, but AI is following a time-honored tradition in tech.
-
Google AI Memo Leak: Quick Thoughts and Analysis
By
–
Today's issue of Supervised is a little more wonky as I want to address the leaked Google AI memo. I'm addressing it in a future issue but you can find some quick thoughts up top:
-
Shopify InterDigital Coinbase lead Thursday stock market winners
By
–
Shopify, InterDigital, Coinbase among Thursday’s winners Analysts once thought Shopify’s logistics business would be a $100 billion annual business $SHOP $COIN $IDCC $AAPL #Investing #stocks #earningsseason
-
Apple Stock Rises Five Percent on Strong iPhone Revenue
By
–
Apple rising: an oasis of relative stability The stock has added to gains, now up almost five percent. https://
thetechnologyletter.com/the-posts/appl
e-rising-as-iphone-revenue-beats-raises-dividend
… $AAPL #stocks #investing #iPhone