Taking a peek behind Hidden Door's AI https://
bit.ly/3PIode9 #AI #MachineLearning #DeepLearning #LLMs #DataScience
MACHINE LEARNING
-
Exploring Hidden Door’s AI Technology Behind the Scenes
By
–
-
GQA and Sliding Window Optimization for Efficient Decoding
By
–
We trained it with GQA and a sliding window of 4096 tokens, resulting in constant cache size and a linear decoding speed. Our changes to FlashAttention v2 and xFormers to support sliding window are available to the community.
-
Mistral AI team builds advanced MLOps stack in three months
By
–
Very proud of the Mistral AI team who rebuilt a top-performance MLops stack, and designed a very sophisticated data processing pipeline, from scratch, in less than 3 months.
-
Mistral 7B Released: Outperforms Llama 2 13B on All Benchmarks
By
–
Mistral 7B is out. It outperforms Llama 2 13B on every benchmark we tried. It is also superior to LLaMA 1 34B in code, math, and reasoning, and is released under the Apache 2.0 licence. https://
mistral.ai/news/announcin
g-mistral-7b/
… -
Four Charts Demonstrating Accelerating AI Progress Trajectory
By
–
4 Charts That Show Why AI Progress Is Unlikely to Slow Down
#AI #AIio #BigData #ML #NLU #Futureofwork @briansolis @Xbond49 @VitalikButerin @DataScienceCtrl @Benioff @johnnosta @IrmaRaste @Tiffani_Bova http://
ow.ly/xnje30sxiN1 -
VideoDirectorGPT: LLM-Guided Multi-Scene Video Generation
By
–
DirectorGPT: Consistent Multi-scene Generation via LLM-Guided Planning Lin et al.: https://
arxiv.org/abs/2309.15091 #ArtificialIntelligence #DeepLearning #MachineLearning -
Sanjay Ghemawat: Long-Time Colleague and AI Collaborator
By
–
My long time colleague and collaborator, Sanjay Ghemawat.
-
AI Quality Depends on Training Data
By
–
AI Is Only As Good As The Data That Trains It
#AI #AIio #BigData #ML #NLU #Futureofwork @Kevin_Jackson @sallyeaves @schmarzo @kdnuggets @akwyz @BrettKing @TechNative @MiaD http://
ow.ly/bKZ830sxiN0 -
AI Deciphers Animal Communication Through Earth Species Project
By
–
What if we could understand what animals are saying? The @earthspecies project is using AI to decipher the language of the wild, and they're making groundbreaking progress. Awesome work by my good friend @aza and team
-
SFT Model Fine-tuning: Addressing Novel Edge Cases with Prompting
By
–
you do, and the need often pops back up e.g. you might prompt an SFT model with instructions for a novel edge case only until you collect enough examples to re-tune