Introduces scaling laws for generative mixed-modal language models. 9 of 11
LLMS
-

Large Language Models Simulate Universal Turing Machine with Memory
By
–
Investigates the use of existing LMs (e.g, Flan-U-PaLM 540B) combined with associative read-write memory to simulate the execution of a universal Turing machine. 7 of 11
-

New Multimodal Deep Learning Book Published on ArXiv
By
–
Multimodal deep learning is a new book published on ArXiv. 4 of 11
-
OpenAI Research on Generative LM Disinformation Risks
By
–
OpenAI publishes new work analyzing how generative LMs could potentially be misused for disinformation and how to mitigate these types of risks. 5 of 11
-

Top Machine Learning Papers of the Week
By
–
Top ML Papers of the Week (Jan 9-15): – DreamerV3
– DeepMatcher
– Multimodal deep learning
– Transformer compiler for RASP
– Potential misuses of LMs and mitigations
– Scaling laws for generative mixed-modal LMs
– Time series forecasting with generative modeling
… 1 of 11 -
Computer CoPilot Vision Now Tractable Through Text Translation
By
–
Computer CoPilot. Was very much the vision with OpenAI Universe https://
openai.com/blog/universe/ , though it was too early. Now feels tractable if you translate everything to/from text (e.g. like in WebGPT). Could be built e.g. as an extension of natbot https://
github.com/nat/natbot -
LLMs Lack True Compositional Reasoning Capabilities
By
–
Read http://
rebooting.ai; it went to press just before LLMs became popular but lays out many challenges for genuine intelligence. I don’t see how LLMs resolve any of them. It’s not compositional and can’t reason, so it’s just a giant but superficial statistical approximator -
ChatGPT Boon or Curse: Educational Impact and Ethical Concerns
By
–
From being 'mildly terrifying' to doing #Homework, is #ChatGPT a boon or curse? https://
businessinsider.in/tech/news/from
-being-mildly-terrifying-to-doing-homework-is-chatgpt-a-boon-or-curse/amp_articleshow/97000516.cms
… #opensource #RLHF #100DaysOfCode #Python #tech #developers #architect #AI #ML #DL #AIEthics #OpenAI #chatgpt3 #code #Coding #GPT3 #gpt4 #gptchat #gpt3chat #chatbot #ChatbotAI -
ChatGPT Productivity Tips for Software Developers
By
–
How to use ChatGPT to boost your #developers productivity https://
dev.to/developeratul/
how-to-use-chatgpt-to-boost-your-developer-productivity-3e5a
… #ChatGPT #OpenSource #RLHF #100DaysOfCode #100Devs #javascript #Python #tech #architect #AI #ML #DL #AIEthics #OpenAI #chatgpt3 #code #Coding #GPT3 #gpt4 #gptchat #gpt3chat #chatbot #ChatbotAI -

ChatGPT Hallucinations Expected Increase Era
By
–
bet we will see a lot of this in the hallucinatory ChatGPT era…