Introducing SeamlessM4T, the first all-in-one, multilingual multimodal translation model. This single model can perform tasks across speech-to-text, speech-to-speech, text-to-text translation & speech recognition for up to 100 languages depending on the task. Details
TOOLS
-
Cursor AI Coding Tool Praised by Developers in Latent Space Podcast
By
–
“Cursor is the best product I've used in a while” – @MacCaw “It's so elegant and easy.” – @AndrewMcCalip “Coding with AI is getting insane.” – @MckayWrigley The Latent Space pod is proud to present: the first podcast with @amanrsanger of @anysphere
! -
Fine-tuning and ControlNet Advances for SDXL Text-to-Image AI
By
–
Seeing the fast follow from the community racing to get fine-tuning and ControlNet working for SDXL has been exciting. These techniques bring text-to-image AI to life. Here are some examples of my dog Queso of SD2.1 Dreambooth (left) vs. SDXL LoRA (right). The quality is
-
Stable Diffusion 1.4 Celebrates One Year Anniversary
By
–
On August 22, 2022 (1yr ago today!) Stable Diffusion 1.4 made its debut. Happy Birthday Stable Diffusion! At last, it seemed like it was finally possible to generate consistently good images from a text prompt.
-
Pixray reaches 1.3 million runs on Replicate platform
By
–
In early 2022 @dribnet
's Pixray was the first text-to-image model on Replicate to reach thousands of runs. Today it's been run a total of 1.3mil times. @dribnet was actually the first Replicate user to request that we build an API instead of just a web ui. The rest is history -
OpenAI’s DALL·E 2 and the Rise of Diffusion Models
By
–
In April 2021, OpenAI announced DALL·E 2 https://
openai.com/dall-e-2 and detailed their transition toward using diffusion models. It felt like the dream was coming true! You could prompt it for a photo of a cat wearing a red hat, and get a cat wearing a red hat! -
DeepDaze: Text-to-Image Generation via Colab
By
–
A few weeks after the release of the OpenAI papers, @advadnoun shared DeepDaze, a Colab notebook that generated images from text. Originally shared here:
https://x.com/advadnoun/status/1348375026697834496
… The images were quite abstract, but legible enough to inspire more experimentation. -
Airbyte’s 300+ Document Loaders Simplify Python LangChain Integration
By
–
Airbyte has 300+ document loaders – this will make it easier to use them in pure python – no need to set up the Airbyte server Bring the necessary context into your LangChains!
-
Stable Diffusion Anniversary: One Year of Generative AI Innovation
By
–
One year ago, we co-released @StableDiffusion
! It has enabled countless creative applications over this past year, opening up new possibilities for the future of generative AI. Since then, we've also released 36 models for public access, including SD 2.x, SDXL, StableLM, etc. -
QLoRA Support Added to Lit-GPT for All LLM Models
By
–
Just added QLoRA support for all LLMs in Lit-GPT: Llama 2, Falcon, Pythia, StableLM, and all others! You can use it via `python finetune/lora.py –quantize "bnb.nf4"` to save significant GPU memory. I've ran a few more benchmarks on the Gh PR here: https://
github.com/Lightning-AI/l
it-gpt/pull/275
…