Thanks! The relative position of normalization is one of the few things that changed about the original transformer architecture. I think it's not exactly clear where it should be placed. Most transformers for texts use post-norm(one above) whereas vision transformers tends to
RESEARCH
-
Google Research Presents 90 Papers at CVPR 2023 Vancouver
By
–
This year Vancouver, BC hosts #CVPR2023, which kicks off today with a full docket of workshops and tutorials. Google Research has a strong presence at CVPR with 90 accepted papers and participation in over 40 workshops and tutorials. Find the full list at https://
goo.gle/3CCxbSU -
Exciting presentation at CVPR 2023 conference this week
By
–
Incredible work on this — we're excited for more people to see this up close at #CVPR2023 this week!
-
Showcasing Spotty Demo for General-Purpose Embodied AI Agents
By
–
We’ll also be showcasing a handful of demos on the showfloor. We brought Spotty to demo some of our exciting recent work towards general-purpose embodied AI agents.
— AI at Meta (@AIatMeta) 18 juin 2023
More on this research ➡️ https://t.co/pbckEfIT3S
5/6 pic.twitter.com/9UvarAcFGsWe’ll also be showcasing a handful of demos on the showfloor. We brought Spotty to demo some of our exciting recent work towards general-purpose embodied AI agents. More on this research https://
bit.ly/3N8LeVg 5/6 -
Team booth available at CVPR2023 conference for discussions
By
–
Outside of all of this, our team will be available in booth #1602 all week — stop by to discuss or see more of our latest research. Have a great #CVPR2023! 6/6
-
Meta Researchers Participate in 18 Workshops This Week
By
–
Throughout the week our researchers will be participating in 18 workshops — hope to see you there! A few to look out for Today
– Computer Vision for Mixed Reality
– International Workshop on Large Scale Holistic Understanding Tomorrow
– 3rd Ego4D & 11th Epic Workshop -
Meta AI Team at CVPR 2023 in Vancouver
By
–
Hey #CVPR2023! We’re here in Vancouver and excited to share new work, showcase demos and participate in interesting conversations this week. Booth #1602 A of things to look out for from the Meta AI team 1/6
-
Meta AI Researcher Larry Zitnick Presents Climate Change Computer Vision Keynote
By
–
Meta AI Researcher, Larry Zitnick will be presenting a keynote on Thursday sharing perspectives and insights on approaching climate change through the lens of computer vision research https://
bit.ly/3Xb38vb 2/6 -
GAIA-1 World Models for Self-Driving and Embodied AI
By
–
catch @alexgkendall and @Jamie_Shotton who'll present GAIA-1 and world model work for self-driving and embodied AI
-
Airstreet AI Portfolio Companies at CVPR 2023
By
–
to @airstreet portfolio and friends at #CVPR2023:
– @V7Labs – @wayve_ai – @synthesiaIO – @NianticLabs