The value of generative AI is here: it's much easier to generate things & work backward putting the final touch on the task than to start from scratch in the 1st place. For real, generative tools aren't everything, but if ChatGPT or Copilot can do a task well & fast, why bother?
GENERATIVE AI
-
High Quality Corpus Training Efficiency for Language Models
By
–
There seems to be some growing hints that a few epochs of training on a high quality (and well deduplicated corpus) is just fine
-
GANs, Discriminators, and Learning Human Error Patterns
By
–
The D in a GAN will, in principle and if ground hard enough, try to learn exactly which errors humans make, and knowing this would make D smarter than a human. That said, I still think there's an important in-practice sense where GANs have more imitation-nature than predictors.
-
Impressive AI Clone Demonstrates Power of Team Collaboration
By
–
So wild how good this clone is! But yeah the team is what makes it even more impressive
-
Stability AI Faces Serious International Legal Defense Challenges
By
–
Your inability to assess how serious the claims are means a lot though! (Plus they have basically confessed.). Stability doesn't have much of a defense that could hold internationally.
-
Human creativity transcends commodity content in AI era
By
–
you're assuming consumption experiences stay static. IMO, humans will always conjure up more complex canvases for our creativity — and thus that'll always mint a small number of creators who can enrapture the creators beyond the commodity content
-
Open Source Translation Models: Transformers vs English Pipeline
By
–
yes open source, vrai travail, par contre sur la fin il parle de traduction et qu'il dit que ca passe par de l'anglais et là c'est pas du tout ça, ils passent par les transformers et pour l'entraînement et Meta a les même résultats en terme de traduction
-
LLMs Confabulate Inherently Despite Infinite Data
By
–
Conjecture: even with infinite data, LLMs would still confabulate, because they blur the inputs and don’t reliably create precise representations of individuals and their properties. (see The Algebraic Mind, 2001 for related discussion which has thus far has held true)
-

Baby GPT as Finite State Markov Chain Visualization
By
–
This is a baby GPT with two tokens 0/1 and context length of 3, viewing it as a finite state markov chain. It was trained on the sequence "111101111011110" for 50 iterations. The parameters and the architecture of the Transformer modifies the probabilities on the arrows. E.g. we
-

ChatGPT Correctly Diagnoses Long COVID When Physicians Failed
By
–
After a patient saw multiple physicians and neurologists over 6 months and was assigned a diagnosis of #LongCovid, a relative entered her symptoms into #ChatGPT with the correct output. Diagnosis was confirmed by antibody testing and therapy has been initiated.