Huge thanks to our compute providers @CoreWeave and the EuroHPC, @tri_dao and @d_haziza for their help with FlashAttention and xFormers, and @huggingface
, vLLM, @skypilot_org
, FastChat for their help and support with this release.
OPEN SOURCE
-
Thanks to compute providers and partners for model release support
By
–
-
GQA and Sliding Window Optimization for Efficient Decoding
By
–
We trained it with GQA and a sliding window of 4096 tokens, resulting in constant cache size and a linear decoding speed. Our changes to FlashAttention v2 and xFormers to support sliding window are available to the community.
-
Mistral 7B Released: Outperforms Llama 2 13B on All Benchmarks
By
–
Mistral 7B is out. It outperforms Llama 2 13B on every benchmark we tried. It is also superior to LLaMA 1 34B in code, math, and reasoning, and is released under the Apache 2.0 licence. https://
mistral.ai/news/announcin
g-mistral-7b/
… -
Mistral AI Releases First Model, Best Open Source 7B
By
–
At @MistralAI we're releasing our very first model, the best 7B in town (outperforming Llama 13B on all metrics, and good at code), Apache 2.0. We believe in open models and we'll push them to the frontier https://
mistral.ai/news/about-mis
tral-ai/
… Very proud of the team ! -
Mistral 7B v0.1 Model Release Available for Download
By
–
magnet:?xt=urn:btih:208b101a0f51514ecf285885a8b0f6fb1a1e4d7d&dn=mistral-7B-v0.1&tr=udp%
http://
2Ftracker.opentrackr.org1337announce&tr=https%https://t.co/HAadNvH1t0443announce RELEASE ab979f50d7d406ab8d0b07d09806c72c -
Presto SQL Engine Now Available in Watson X Platform
By
–
Now available within #watsonx, Presto is an open-source, distributed #SQL query engine that can analyze large #data sets with: Lower costs Increased scalability Better performance Improved flexibility Deep dive into Presto, here: https://
ibm.biz/BdMQVB -
Training YOLOv8 Object Detection with KerasCV and TensorFlow
By
–
🚀Blog-tastic Tuesdays🚀https://t.co/qDpaFplJU0
— Satya Mallick (@LearnOpenCV) 26 septembre 2023
YOLOv8 is the latest addition to the KerasCV library. With an easy training pipeline and high performance, it is now a breeze to use YOLOv8 with TensorFlow and Keras. Our latest article shows how to train the KerasCV YOLOv8 model… pic.twitter.com/WDV5JuiKaXBlog-tastic Tuesdays https://
learnopencv.com/object-detecti
on-using-kerascv-yolov8/
… YOLOv8 is the latest addition to the KerasCV library. With an easy training pipeline and high performance, it is now a breeze to use YOLOv8 with TensorFlow and Keras. Our latest article shows how to train the KerasCV YOLOv8 model -
Cost-effective domain-specific LLM training achieves mainstream model results
By
–
One half-day of training using a few hundred dollars yields similar results to mainstream large models, open-source and commercial-free domain-specific LLM solution | https://
bit.ly/3LDKEie
#AI #ML #ArtificialIntelligence #MachineLearning #DeepNeuralNetwork #LLMs -
Ludwig v0.8.4 Release: Major LLM Enhancements and Improvements
By
–
We're pleased to introduce an exciting new minor release (v0.8.4) that brings significant enhancements to your @ludwig_ai experience including enhancements for #LLMs. Thank you to all of our amazing contributors! Download Ludwig v0.84: https://
pbase.ai/3rqHiZg. -
Understanding Neural Networks: Core Concepts and Applications
By
–
What are Neural Networks? #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #100DaysofCode https://
geni.us/What-Neural-Ne
ts
…