9/ Multimodal Table Understanding – introduces Table-LLaVa 7B, a multimodal LLM for multimodal table understanding; it’s competitive with GPT-4V and significantly outperforms existing MLLMs on multiple benchmarks.
MULTIMODAL AI
-
Visual Chain of Thought: Sketching Framework for Multimodal LLM Reasoning
By
–
7/ Sketching as a Visual Chain of Thought – a framework that enables a multimodal LLM to access a visual sketchpad and tools to draw on the sketchpad; it can equip a model like GPT-4 with the capability to generate intermediate sketches to reason over complex tasks.
-
Luma AI reasons from text in uploaded images for unboxing video
By
–
Demo showing Luma AI reasons from text in uploaded images:
— Riley Goodside (@goodside) 16 juin 2024
1. Make cardboard box in Dalle 3
2. Write “Strawberries” on box
3. Send to Luma AI with text prompt: “Unboxing video” pic.twitter.com/GPyctgZYn8Demo showing Luma AI reasons from text in uploaded images: 1. Make cardboard box in Dalle 3
2. Write “Strawberries” on box
3. Send to Luma AI with text prompt: “Unboxing video” -
Gemini 1.5 Pro with 2M context now available
By
–
ICYMI: Gemini 1.5 Pro with 2 million tokens of context is rolling out on AI Studio to the first group of whitelisted users.
-
Stable Diffusion to Full AI Movie Generation Progress
By
–
2022:
— Carlos Santana (@DotCSV) 14 juin 2024
Bufff Stable Diffusion genera imágenes bastante decentes! En un par de años estaremos creando películas enteras con un sólo prompt!
2024: pic.twitter.com/sgyWaJyPPj2022:
Bufff Stable Diffusion genera imágenes bastante decentes! En un par de años estaremos creando películas enteras con un sólo prompt! 2024: -
Simulation Hypothesis: Neural Approximation Over Physical Exactness
By
–
New simulation hypothesis drop.
Maybe the simulation is not physical and exact but neural and approximate.
i.e. not about simulating fields or particles with physical equations but a giant Diffusion Transformer++ creating a large "dream". -
Luma Labs AI Video Generation from Images Impresses Karpathy
By
–
wow. The new model from @LumaLabsAI extending images into videos is really something else. I understood intuitively that this would become possible very soon, but it's still something else to see it and think through future iterations of.
— Andrej Karpathy (@karpathy) 13 juin 2024
A few more examples around, e.g. the… https://t.co/zH1xjAgrNnwow. The new model from @LumaLabsAI extending images into videos is really something else. I understood intuitively that this would become possible very soon, but it's still something else to see it and think through future iterations of. A few more examples around, e.g. the
-
Stable Diffusion 3 Medium Launches on Poe Platform
By
–
Stable Diffusion 3 Medium is now on Poe! SD3 Medium is the latest image model from Stability AI and is capable of generating impressive images exceptionally fast. It is particularly good at understanding detailed prompts, text generation, and photorealism. (1/2)
-
OpenAI’s Sora has a new competitor available, test and release date
By
–
#Sora from @OpenAI has a new competitor and it's already available for EVERYONE! I'm testing it for you and take the opportunity to tell you more about the (upcoming!) release date of Sora → https://youtu.be/_XTu0wDKvcM
