GPT is becoming a Turing machine: Here are some ways to program it Ana Jojic, Zhen Wang, Nebojsa Jojic: https://
arxiv.org/abs/2303.14310 #GPT #ChatGPT #TuringMachine
RESEARCH
-
GPT as Turing Machine: Programming Capabilities Explained
By
–
-
LeCun’s AI Risk Assessment Contradicts Expert Consensus
By
–
Yann LeCun thinks the risk of AI taking over is miniscule. This means he puts a big weight on his own opinion and a miniscule weight on the opinions of many other equally qualified experts.
-
Chess AI Evolution: From Alpha-Beta to Monte-Carlo Tree Search
By
–
Chess players are all about planning.
It used to be Alpha-Beta tree search with a fixed, handcrafted evaluation function.
Nowadays, it's Monte-Carlo Tree Search with a policy network to pick good candidate branches and a Value network that learns to evaluate nodes.
But planning -
Math Updates Required for Next Generation AI
By
–
Seems the math needs to be updated for nextgen https://
x.com/choldgraf/stat
us/1727819994640289935
… -
AI Acceleration Drives Progress in Scientific Research
By
–
Accelerating the development of AI will help accelerate scientific progress across the board.
-
Ethics Beyond Utilitarianism: Balancing AI Decision-Making
By
–
For sure but they were never unfettered utilitarianists. EA has good aspects but you gotta actually use some common sense and listen to your inner voice too.
-
Self-Attention Mechanism in Large Language Models Explained
By
–
Understanding and Coding the Self-Attention Mechanism of Large Language Models From Scratch https://
bit.ly/3YL821l #AI #DeepLearning #MachineLearning #DataScience -
AGI debate video premieres in 75 minutes
By
–
The cideo of our AGI debate premieres 75 minutes from now.
-
Proposal for Language Modeling Competition Between Humans and AI
By
–
Like the International Math Olympiad or Spelling Bee, there should be a “language modeling competition” where humans compete to predict the next word in a sequence. The best humans would probably still lose to GPT-2, and we’d have more empathy for how hard it is to be an LLM 🙂
-
Self-Supervised Learning for Vision and World Models
By
–
Self-Supervised learning.
Particularly for vision and world models.