the best part about that example is that it doesn’t even use gpt-4's visual abilities I can’t wait to see how much more powerful it will be when that is incorporated
MULTIMODAL AI
-
LLMs Future Value: UI Tool Operation Over Text Generation
By
–
my take is that text generation will not be the main value prop of LLMs very soon instead, it will be their ability to operate the tools we already use in this example, gpt-4 proves that it has a near-human level of understanding of discord's UI through just one screenshot
-

Multimodal Learning Research: Upcoming Resource Collection
By
–
Multimodal learning is one of my favorites areas of research. We've done a great job of designing systems that learn from single modalities but not so much about learning from multiple modalities. I am putting MML resources together and will share over the next couple of days.
-

Project AI 2.0 Recruiting Global Talents in LLM and AI
By
–
I am leading a new venture-building initiative "Project AI 2.0" — now recruiting global talents in LLM, multi-modality, AI algo, infra, etc. Welcome to reach out or send great referrals to us! https://
chuangxin.com/ai2 -
Video as Factual Data: Spatiotemporal Insights in AI Vision
By
–
can be factual observations of the real world. Lot of useful spatiotemporal insights encoded in those pixels.
-
AI Blurs Lines Between Reality and Creative Imagination
By
–
We're literally on the cusp of freely kit-bashing reality and imagination
-
Capture Your Reality and Build the Mirror World
By
–
capture your own reality and contribute to the mirror world
-

AI-Generated Images Improving Rapidly Despite Remaining Flaws
By
–
this *fake* trump arrest ai generated photo still looks over-stylized and fake and the hands are weird as per usual…but hard not to see how much better this is getting in a short amount of time
-

Multimodal AI Impact on Medicine and Healthcare Systems
By
–
If you're interested in understanding the potential impact of #LLMs, #GPT4, and multimodal systems in the field of health and medicine, this article is a great read: https://
erictopol.substack.com/p/multimodal-a
i-for-medicine-simplified?utm_campaign=post&utm_medium=web
… -
Smart Cities Future: IoT, Digital Twins and Robotics
By
–
How will the #smartcities of the future look?
— Amitav Bhattacharjee (@bamitav) 19 mars 2023
CC: @IntEngineering #IoT #IIoT #digitaltwin #Robot #Robotic @MikeQuindazzi @jblefevre60 @Fisher85M @ValaAfshar @andrewmorrisuk @sayedflah @TechNitin @FGraillot @terenavarrolb @futurism @WrongsToWrite #Engineering #futuretech pic.twitter.com/ydazlgccGQHow will the #smartcities of the future look? CC: @IntEngineering #IoT #IIoT #digitaltwin #Robot #Robotic @MikeQuindazzi @jblefevre60 @Fisher85M @ValaAfshar @andrewmorrisuk @sayedflah @TechNitin @FGraillot @terenavarrolb @futurism @WrongsToWrite #Engineering #futuretech