AI NEWS: Google DeepMind just introduced an AI agent that plays video games with you. Plus, more developments from OpenAI Sora, Figure, Anthrophic, Devin, Oracle, and Elon Musk. Here's everything going on in AI right now:
MULTIMODAL AI
-
SIMA Team Achieves Breakthrough in Video Agent Models
By
–
It’s wonderful to see this work coming to fruition. Congratulations SIMA team. I want to use this opportunity to highlight @scott_e_reed who after finishing Gato (a generalist agent) worked tirelessly with our colleagues to build video agent models and code infrastructure that… https://t.co/su8yFKKYK2
— Nando de Freitas (@NandoDF) 13 mars 2024It’s wonderful to see this work coming to fruition. Congratulations SIMA team. I want to use this opportunity to highlight @scott_e_reed who after finishing Gato (a generalist agent) worked tirelessly with our colleagues to build video agent models and code infrastructure that
-
AI Model Recognizes Visual Cues of Gentrification
By
–
Gentrification and its consequences are difficult to measure. Scholars including @StanfordHAI faculty affiliate Jackelyn Hwang trained an AI model with images from Google Street View to recognize the visual cues of gentrification. https://
stanford.io/3vl16yW -
Claude 3 Excels at ASCII Art Better Than GPT-4
By
–
Every previous AI model, including GPT-4, is really bad at ASCII art. Claude 3 is really impressive. (As you can see, it does hallucinate when asked to do more "artistic" work, but does really well on more structured outcomes).
-
Generative AI and 3D Design Innovation in Marketing Industry
By
–
Come see Stephan Pretorius, Chief Technology Officer of @WPP
, at #GTC24 to delve into how the marketing and advertising industry is innovating with #generativeAI and 3D design using @NVIDIAOmniverse and enterprise AI technologies. https://
nvda.ws/43g3cwC -
Haiku AI Model Delivers Advanced Vision and Enterprise Capabilities
By
–
With state-of-the-art vision capabilities and strong performance on industry benchmarks across reasoning, math, and coding, Haiku is a versatile solution for a wide range of enterprise applications.
-
Gemini 1.5 Video Reasoning: Safety Detection and Temporal Analysis
By
–
I don't think people are appreciating what capabilities are possible when AI can reason over an entire video (or live video feed). I gave Gemini 1.5 a video of traffic and asked it to identify dangerous situations, and to guess the year of the video, and got accurate answers.
-
Vision-Language-Action Learning in Robotics: Progress Discussion
By
–
TY David for a very fun discussion about the state of the art in robotics, including new developments in robot vision-language-action learning, and why progress is not exponential!
-
AI Voice Indistinguishability From Human Speech Reaches 95%
By
–
Yup. AI voice is probably already indistinguishable from human to 95% of people imo
-
Figure Robot Humanoid Qualities Praised Despite Stuttering Behavior
By
–
It makes Figure seem really humanoid. People are commenting about the stuttering, but I’m a fan of it.