people who say "nobody knows" how ai does what it does are, at this point, obfuscating (and/or *they* don't know). systems are still commonly called "black boxes" etc but it's increasingly clear how they work (which can vary based on things like the architecture of the model).
AI
-
ChatGPT surpasses doctors in empathy according to JAMA study
By
–
Pensez-vous que nous sommes à un tournant du monde médical ? Mes confrères sont stupéfaits Une étude dans la grande revue médicale #JAMA montre que #ChatGPT est BEAUCOUP plus empathique que nous médecins Et cette étude a été réalisée avec GPT3 et non GPT4 Votre avis ?
-
RNN Cells: A PhD Research Retrospective on Recurrent Architecture
By
–
Ah, RNN cells. I seldom share the work I did during my PhD (pre-Google) but I thought maybe people would find this work fun and amusing. https://
arxiv.org/abs/1811.09786 Throwback to the fond memories of drawing recurrent cells in papers. If you look into that paper you will see that -
Early OSS lightweight models testing formats private beta
By
–
As a funny aside, one of the early private beta stories I circulated among friends a few months ago as I was testing formats was literally titled “a model in your pocket” and about low-param OSS models. Whoops.
-
Productivity in Engineering and Technology Innovation
By
–
What Is Productivity? https://
mckinsey.com/featured-insig
hts/mckinsey-explainers/what-is-productivity
… @ASMEdotorg @3DSNorthAmerica @cyngn @MargaretSiegien @3DSdelmia @3DStherese @Cindybolt61 @fogoros @DrFerdowsi @CRudinschi @PawlowskiMario @IIoT_World @MEngineeringMag #Science #Engineering #Technology #SET -
JAX Omission Raises Questions About AI Training Technology Strategy
By
–
There’s no mention of JAX. That was a little weird as they own an extremely powerful next-generation training technology in the same way they owned TensorFlow at first.
-
Google’s Strategic Missteps in AI and Open Source Innovation
By
–
Google keeps falling asleep at the wheel here. It didn’t productize MapReduce, allowing Hadoop to happen. It let PyTorch blossom and take over the DS/DL community. And now it has basically let competitors run off with the Transformers technology.
-
Compare GPT Models Simultaneously with This New Tool
By
–
Ever wish you could compare GPT models simultaneously ? @zwack010 built a sample app so you can do it in seconds.
— Replit ⠕ (@Replit) 5 mai 2023
Just plug in your API key and start prompting. pic.twitter.com/fBCNbyR8PZEver wish you could compare GPT models simultaneously ? @zwack010 built a sample app so you can do it in seconds. Just plug in your API key and start prompting.
-
GPT-4 Architecture: Parameter Count and Competitive Moat Analysis
By
–
OpenAI is mentioned in here as having no moat, but OpenAI was also intentionally silent about the parameter count of GPT-4. I know some people have been flinging around a 1T parameter number for GPT-4 but it’s very possible that it isn’t a single 1T model and instead 1T total.
-
Meta’s LLaMA Leak: Legal Implications and Open Source Adoption
By
–
And you have to appreciate the stance here which is basically like “what is Meta going to do, sue all the people using the leaked LLaMA model?”