the scheduler side of things is a whole another level of complexity. we dont reprovision from scratch though.
SOFTWARE
-
Data Engineers Critical for GenAI Success and Code Development
By
–
The best #GenAI models will not succeed without good data. That’s why data engineers are even more critical today. This guide shares practical guidance on using AI tools for faster code dev, implementing data governance & more. Read here
-
Building FastHTML Apps Without Writing JavaScript Code
By
–
Lots of my fasthtml apps involve me writing no js fyi
-
Training Models at Scale: 10K+ H100 Infrastructure Guide
By
–
quick mini-post I wrote for @francoisfleuret broadly summarizing the things one needs to do to train models on 10k+ H100s.
-
Scaling AI Training Across Thousands of H100 GPUs
By
–
There's three parts. 1. Fitting as large of a network and as large of a batch-size as possible onto the 10k/100k/1m H100s — parallelizing and using memory-saving tricks.
2. Communicating state between these GPUs as quickly as possible
3. Recovering from failures (hardware, -
MongoDB Schema Modeling: Beyond Schemaless Myth
By
–
Challenge accepted! I think my point would be that you can model your data in MongoDB as you would in PG. there are good reasons why documents could get you farther, depending on the workload, but this idea of "schemaless" MongoDB has always been wrong. There's always schema.
-
Everyday Transformers Optimizations: KV Cache, FlashAttention, PagedAttention
By
–
This blog post is really cool: to understand everyday Transformers optimizations like KV cache, FlashAttention or PagedAttention: https://
astralord.github.io/posts/transfor
mer-inference-optimization-toolset/
… Image below is the interactive visualization for KB cache! -
YouTube-Whisper: YouTube Video Audio Transcription with Whisper
By
–
Youtube-Whisper
— AK (@_akhaliq) 2 octobre 2024
A simple Gradio app that transcribes YouTube videos by extracting audio and using OpenAI’s Whisper model for transcription. Paste a YouTube link and get the video’s audio transcribed into text. pic.twitter.com/c6aNzjNYCiYoutube-Whisper A simple Gradio app that transcribes YouTube videos by extracting audio and using OpenAI's Whisper model for transcription. Paste a YouTube link and get the video's audio transcribed into text.
-
AI Trends: Quantum Computing, Copilot Updates, Productivity Gains
By
–
Prêts pour la crème de la crème de la Tech ? L'IA va remplacer les mauvais managers IBM ouvre le 1er datacenter quantique en Europe La FED doute des gains de productivité de l’IA Microsoft Copilot se refait une (vraie) beauté Julie Huguet, nouveau visage de la
