Oh, and sorry, @DrJimFan
, even the 2014 paper is not the original attention paper. It goes actually back to 1991 (via @SchmidhuberAI
) in https://
semanticscholar.org/paper/Learning
-to-Control-Fast-Weight-Memories-An-to-Schmidhuber/bc22e87a26d020215afe91c751e5bdaddd8e4922
… I've summarized it here: https://
magazine.sebastianraschka.com/p/why-the-orig
inal-transformer-figure
…
AI
-
Attention Mechanism Origins Traced Back to 1991 Schmidhuber
By
–
-
Education as mitigation for knowledge gaps in AI
By
–
lack of education perhaps (which is what my tweet is supposed to mitigate).
-
Deep Learning Lecture: From RNNs to Transformer Architecture
By
–
Link to the lecture in case someone's curious: https://
lightning.ai/pages/courses/
deep-learning-fundamentals/unit-8.0-natural-language-processing-and-large-language-models/8.4-from-rnns-to-the-transformer-architecture/
… -
University of Kansas researchers create AI text detector
By
–
University of Kansas researchers believe they have developed an AI text detector with 99% accuracy:
-
Bahdanau Attention as Essential Foundation for Transformer Learning
By
–
Yup! I always start my book chapters, lectures, etc with Bahdanau attention paper. I think it's a great intro & motivation for developing transformers. Without it, it would feel like sth is missing.
-
Comparison of BoW and BERT Models on Same Dataset
By
–
Yes, the two links above. It's both on the same dataset. One is a BoW model, one is a BERT model.
-
Sundar Pichai Discusses Future of AI at Google
By
–
I got the chance to hang out with @sundarpichai and chat about the future of AI at Google and beyond. I'm really excited to see so many great engineers & teams working on this. PS: We'll do a podcast eventually. Sundar is a fascinating human being, and is really fun to talk to!
-
The Promise and Pitfalls of Relying on Artificial Intelligence
By
–
The promise and pitfalls of relying on artificial intelligence
#AI #AIio #BigData #ML #NLU #Futureofwork @nigelwalsh @pbouillaud @PatrickGunz_CH @pierrepinna @RebekahRadice @Ronald_vanLoon @sbmeunier
@Shirastweet http://
ow.ly/Um1h30svHSJ -
Coronavirus as a Pokemon – Weird DALLE Reddit Thread
By
–
reddit thread: https://reddit.com/r/weirddalle/comments/147bnuq/coronavirus_as_a_pokemon/
