nice, exactly! 🙂
(except you're swapping q's and k's – q is the query, the "what am i looking for", k is the key, the "what do i have", and in encoder-decoder the key,value from come from side. admittedly confusing because in dictionaries the _key_ is the "lookup" information.)
RESEARCH
-
Clarification on Query and Key in Attention Mechanisms
By
–
-
AI excels at teaching and copying, struggles with novel ideas
By
–
Good callout! Wording could definitely be tighter (and I'm by no means an expert here, just going off of my best understanding). My main point here is that AI is better at things that can be taught and copied than at novel idea generation, and I think that stands.
-
Excitement for 2023 Language AI Research and Team Achievements
By
–
Delighted to see the work from our team (chain-of-thought prompting, emergent abilities, self-consistency, med-palm) featured here, and super excited for language AI research to continue in 2023!
-
MIT App Inventor Foundation Launches to Empower Community App Creators
By
–
Seeing that @MITAppInventor is far beyond the normal size of a research project, we decided to launch the App Inventor Foundation, a 501c3 nonprofit incubated @MIT_CSAIL
. Its mission is to empower people of all backgrounds to create apps that uplift their communities (3/N) -
MIT App Inventor Reaches 9.2 Million Users Globally
By
–
@MITAppInventor grew extremely quickly in the past 2 years. It’s run by a small team of 10 people in a lab @MIT_CSAIL
, yet reached 9.2 million people across 200 countries in the last year alone. This makes it the largest #edtech project currently hosted @MIT
! (2/N) -
MIT App Inventor Foundation Launches CS and AI Education Initiative
By
–
We’re launching App Inventor Foundation, a new #nonprofit focused on CS+AI education and outreach, to amplify world-class research from @MITAppInventor into real-world impact! More details below https://
appinventorfoundation.org (1/N) -
ML Education Framework and AI Tools for K-12 Students
By
–
I stayed @MITAppInventor for my Masters, where I used #Redis to develop cloud data tools for K-12 education. I enjoyed my research so much that I applied for a PhD, where I created a framework for #ML education and developed edtech tools for kids to explore #AI. (6/7)
-
MIT AppInventor Research Assistant Role in Educational Technology
By
–
When I got back to MIT, I was eager to keep working in edtech. I found the prof in charge of @MITAppInventor and knocked on his door to ask how I could help. To my surprise, Hal invited me to be a research assistant in his lab through the @UROP_mit program! (5/7)
-
Children Learn Best Through Active App Creation Projects
By
–
AI pioneer #SeymourPapert said “children learn best when they are actively engaged in constructing something that has personal meaning to them.” I saw this firsthand when teaching @MITAppInventor
. My students were amazed that they could make apps with no prior experience!(4/7) -
Google AI Research 2022: Language Models and Generative AI
By
–
Excited to share the first of a series of @GoogleAI blog posts summarizing our research work from 2022. This covers language & multimodal models, computer vision, and generative models. We'll have ~7 posts covering other areas over next few weeks! https://
ai.googleblog.com/2023/01/google
-research-2022-beyond-language.html
…