@GroqInc recently became the world's first to achieve the 100 t/s/u responsiveness milestone for text generation on @MetaAI
's #Llama2 70B model. Before the celebratory swag made it to Toronto, the team already blew past their record. Stay tuned for news about our latest milestone
OPEN SOURCE
-
Groq Achieves 100 Tokens/Second Milestone with Llama2 70B
By
–
-
Meta Launches SeamlessM4T, Open Source Multilingual Model
By
–
Meta unveils SeamlessM4T, an open source multilingual and multimodal foundational model https://actuia.com/actualite/meta-devoile-seamlessm4t-un-modele-de-base-multilingue-et-multimodal-open-source/
… #AI #artificialintelligence #opensource -
Potential Competitor to Triton for Python Users
By
–
Yeah, we’ll see. It’s probably not going to be used by the average Python users, but I can see it becoming a competitor for Triton though.
-
New startup founded by former TensorFlow.js creators
By
–
A new startup founded by former members of team that created TensorFlow.js at Google Brain 🧠 https://t.co/xVsGIdBBzG
— hardmaru (@hardmaru) 25 août 2023A new startup founded by former members of team that created TensorFlow.js at Google Brain
-
Simplifying PyTorch by removing C++ dependencies
By
–
What I am really hoping for is that it will help simplify code bases, though. Maybe we can get rid of the C++ parts of PyTorch this way to make development easier.
-
PyTorch Python overhead and realistic performance gains discussion
By
–
2/2
PyTorch's Python overhead is usually quoted to be at ~10% (compared to PyTorch's C++ API). I think for PyTorch users (or CUDA-dependent packages), the speed advantage is probably more going to be in the single digit range, not 35,000x.
Still super exciting though! -
Checkpoint Support Development in Progress for Lit-GPT
By
–
Checkpoint support is in the works: https://
github.com/Lightning-AI/l
it-gpt/issues/464
… -
CodeLlama-Python 34B finetuned on unnatural instructions
By
–
It's CodeLlama-Python 34B finetuned on 15,000 unnatural instructions. What's an unnatural instruction? Would like to see a few examples 😛
-
Open Tech in AI and Crypto: Key Insights
By
–
Great fireside chat on “The importance of open tech in AI and crypto” with @connerruhl of @StabilityAI and @jessepollak of @BuildOnBase moderated by @joey_debruin as part of the http://
100.Builders kick off! See below for highlights and check out the live chat here – -
RAGAS Framework for RAG Systems Evaluation with LangSmith
By
–
RAGAS is an awesome open-source framework for evaluating RAG systems We recently integrated LangSmith RAGAS for optimal ease of evaluation We're also doing a webinar on RAG evaluation with them in 5 minutes!!! Link to webinar and blog