DeepMatcher is a transformer-based network showing robust local feature matching, outperforming the state-of-the-art methods on several benchmarks. 10 of 11
@dair_ai
-
Transformers in Reinforcement Learning: A Comprehensive Survey
By
–
A Survey on Transformers in Reinforcement Learning 8 of 11
-
Scaling Laws for Generative Mixed-Modal Language Models
By
–
Introduces scaling laws for generative mixed-modal language models. 9 of 11
-
Large Language Models Simulate Universal Turing Machine with Memory
By
–
Investigates the use of existing LMs (e.g, Flan-U-PaLM 540B) combined with associative read-write memory to simulate the execution of a universal Turing machine. 7 of 11
-
New Multimodal Deep Learning Book Published on ArXiv
By
–
Multimodal deep learning is a new book published on ArXiv. 4 of 11
-
OpenAI Research on Generative LM Disinformation Risks
By
–
OpenAI publishes new work analyzing how generative LMs could potentially be misused for disinformation and how to mitigate these types of risks. 5 of 11
-
DeepMind Tracr: Compiler Converting RASP to Transformer Weights
By
–
DeepMind proposes Tracr, a compiler for converting RASP programs into transformer weights. This way of constructing NNs weights enables the development and evaluation of new interpretability tools. 3 of 11
-
Top Machine Learning Papers of the Week
By
–
Top ML Papers of the Week (Jan 9-15): – DreamerV3
– DeepMatcher
– Multimodal deep learning
– Transformer compiler for RASP
– Potential misuses of LMs and mitigations
– Scaling laws for generative mixed-modal LMs
– Time series forecasting with generative modeling
… 1 of 11 -
DreamerV3 Achieves Minecraft Diamond Collection Without Human Data
By
–
DreamerV3 is a general algorithm to collect diamonds in Minecraft from scratch without human data or curricula, a long-standing challenge in AI.
— DAIR.AI (@dair_ai) 15 janvier 2023
2 of 11https://t.co/pvsmnX3TPODreamerV3 is a general algorithm to collect diamonds in Minecraft from scratch without human data or curricula, a long-standing challenge in AI. 2 of 11
-
Comprehensive Prompt Engineering Guide with References
By
–
Prompt Engineering Guide (1.1K) This new guide helps you find the latest & greatest information regarding prompt engineering. More references were added. Lecture + notebook coming soon! https://
github.com/dair-ai/Prompt
-Engineering-Guide
…