Compared to Mistral 7B, Mixtral is significantly stronger in science, in particular in mathematics and code generation. (5/n)
AI
-
Mixtral Architecture: 8 Feedforward Blocks with Router-Selected Experts
By
–
Mixtral has a similar architecture as Mistral 7B, with the difference that each layer is composed of 8 feedforward blocks. For every token, at each layer, a router network selects two experts to process the current state and combine their outputs. (2/n)
-
Mixtral: 12B Speed with 45B Parameter Access via Expert Selection
By
–
Even though each token only sees two experts, the selected experts can be different at each timestep. As a result, Mixtral decodes at the speed of a 12B model, while effectively having access to 45B parameters. (3/n)
-
Mixtral 8x7B: Open Weight Mixture of Experts Model Released
By
–
Very excited to release our second model, Mixtral 8x7B, an open weight mixture of experts model.
Mixtral matches or outperforms Llama 2 70B and GPT3.5 on most benchmarks, and has the inference speed of a 12B dense model. It supports a context length of 32k tokens. (1/n) -
New Research Initiative on General World Models Announced
By
–
Introducing General World Models.
— Runway (@runwayml) 11 décembre 2023
We believe the next major advancement in AI will come from systems that understand the visual world and its dynamics, which is why we’re starting a new long-term research effort around general world models.
Learn more: https://t.co/Z4JWm6dJjG pic.twitter.com/X8dW8fSv1YIntroducing General World Models. We believe the next major advancement in AI will come from systems that understand the visual world and its dynamics, which is why we’re starting a new long-term research effort around general world models. Learn more: http://
bit.ly/3RexmuJ -
Wife’s Favorite LLM: A Humorous Marriage Counseling Moment
By
–
My wife and I were at a married couples counseling meeting. The speaker was asking the audience random questions. Then he called on me and said, "Sir do you know what your wife's favorite LLM is?" Feeling kind of singled out, I turned to my wife and said, "It's Llama, isn't
-
Blob Detection with OpenCV and Python Tutorial Video
By
–
🎥New Video Alert🎥https://t.co/bOYjLzBpHi
— Satya Mallick (@LearnOpenCV) 11 décembre 2023
Check out our latest video as we explore blob detection with OpenCV and Python. You’ll learn how to detect and analyze blobs in images.#AI #computervision #learnopencv #blobdetection #python #opencv pic.twitter.com/VATOdjsIGzNew Alert https://
youtube.com/watch?v=5ilvmX
jtkX8
… Check out our latest video as we explore blob detection with OpenCV and Python. You’ll learn how to detect and analyze blobs in images. #AI #computervision #learnopencv #blobdetection #python #opencv -
Michael’s Scientific Impact: 36000 Citations Achievement
By
–
Michael's scientific publications have been cited over 36000 times by other scientists.
3 of his papers were influential enough to gather over 2000 citations each.
That's the record and achievements. Who do you think are "people like @mmbronstein
" ?
And who the hell are you? -
Wadhwani AI CEO discusses AI solutions for agriculture, health, education
By
–
Shekar Sivasubramanian, CEO, Wadhwani AI, talks to @IndianExpress about how we develop AI solutions across agriculture, health and education, the associated challenges, and the ecosystem needed to nurture it
-
India Government Support for GPAI 2023 Summit in Delhi with PM Modi
By
–
Incredible support from India government for our GPAI 2023 Summit in Delhi with the Honorable Prime Minister Modi to open the event. Thank you 🙏🏻 IndiaAI (@OfficialINDIAai) Counting down the days to the Global Partnership on Artificial Intelligence Summit 2023 in New Delhi! Join us from December 12-14 at Bharat Mandapam for an immersive journey into the world of AI.🚀Honored to have Prime Minister @narendramodi inaugurate the summit on December 12 at 5:00 PM IST. Don't miss this groundbreaking event! 🔎🤖Register here to join virtually- live.negd.in/login/ @AshwiniVaishnaw @Rajeev_GoI @Inria @GoI_MeitY @_DigitalIndia @abhish18 @PIB_India @Google @nvidia @UNESCO @CEIMIA_mtl @omarsalolama @kavitabha @inma_martinez @PJMFnd @vilasdhar @OpenAI @gabramosp @annaadeola #GPAISummit #AIInnovation #NewDelhi #NarendraModi — https://nitter.net/OfficialINDIAai/status/1734179285924200529#m
→ View original post on X — @inma_martinez, 2023-12-11 12:10 UTC