LENS, a zero trainable params multimodal framework is shown below. It's frozen CLIP, BLIP, and LLM doing all the works.
MULTIMODAL AI
-

LENS: Vision Language Models Using Frozen Modules
By
–
Towards Language Models That Can See:
Computer Vision Through the LENS of Natural Language LENS is a modular approach that can solve computer vision and vision language tasks using frozen vision modules and LLM. LENS can achieve reasonably good zero-shot/few-shot -
OpenFlamingo v2: Enhanced Multimodal AI Model Released
By
–
Our friends @anas_awadalla (U of Washington) and @irena_gao (Stanford) released this cool project with our compute support: OpenFlamingo v2: New Models and Enhanced Training Setup. Pls check it out on our AI blog and provide feedback!
-
AI Cannot Distinguish Itself From Real Content
By
–
And the #AI can't distinguish whether it's #AI or real. https://
nytimes.com/interactive/20
23/06/28/technology/ai-detection-midjourney-stable-diffusion-dalle.html
… by @stuartathompson and @tiffkhsu -
Large Language Models Applied to DNA, Proteins, Biological Data
By
–
@NEJM a tour de force review
Large "language" #AI models aren't just for words–they can be used for DNA, proteins and all the biologic dimensions of data https://
nejm.org/doi/full/10.10
56/NEJMra2204787?query=featured_home
… by @euanashley and Bruna Gomes -

Medical Image Labeler App for Healthcare AI Imaging
By
–
Have you tried the Medical Image Labeler app? Let us know below #MedicalImaging #DataProcessing #ImageSegmentation
-
AI Research: Multi-Modal Summarization and Behavior Analysis
By
–
Dive into the fascinating world of AI research! Discover the power of multi-modal summarization, social media engagement prediction & player behavior analysis in card games. Tap the link and read this segment of INDIAai's 'Research Roundup': https://
rb.gy/om1o6 -
NeRF Technology Enables Walking Through Personal Memory Experiences
By
–
Wait until they turn into a NeRF and then you walk around your own memories in some future glasses. Or your kids will. Or your grandkids.
-
LAMs Enable Automation of Entire Business Processes Beyond Text
By
–
“Just as LLMs made it possible to automate the generation of text, and, in their multi-modal forms, a wide range of media, LAMs may soon make it possible to automate entire processes”
-
NeRF Technology Creates Immersive 3D Capture in New York
By
–
I did make a NeRF in New York. https://
captures.lumalabs.ai/superior-refin
ed-6-1372164?mode=video
…
