Introducing a novel mixture-of-experts routing algorithm, called Expert Choice, that can achieve optimal load balancing between experts while allowing heterogeneous token-to-expert mapping. Learn how it’s done at https://
goo.gle/3OdpO9t
CODE
-
Expert Choice: Novel Mixture-of-Experts Routing Algorithm
By
–
-
LangChain 0.0.14 Release with GitHub Actions and Vector DB Improvements
By
–
🦜🔗LangChain version 0.0.14
— LangChain (@LangChain) 16 novembre 2022
🧹Improve GitHub Actions (@PredragGruevski)
🎉Improve env var handling (@deliprao)
🥗Improve coloring of logginghttps://t.co/LuIrkDkbzM
Also, here's an example of using the new vector DB question/answering chainhttps://t.co/hPFqkC1l2cLangChain version 0.0.14 Improve GitHub Actions (
@PredragGruevski
)
Improve env var handling (
@deliprao
)
Improve coloring of logging https://
github.com/hwchase17/lang
chain
… Also, here's an example of using the new vector DB question/answering chain -
TensorFlow and Keras Deep Learning Tutorial Without PhD Required
By
–
TensorFlow, Keras, and deep learning, without a Ph.D. What you'll learn: • What is a neural network
• How to build one
• Learning rate schedules
• How to build convolutional neural networks
• How to use regularization
• What is overfitting https://
codelabs.developers.google.com/codelabs/cloud
-tensorflow-mnist/#0
… -
Eliminating Gender Bias in Sentiment Analysis Systems
By
–
De-biasing sexist sentiment classifiers pic.twitter.com/QBLJtIknN6
— IBM Data, AI & Automation (@IBMData) 16 novembre 2022De-biasing sexist sentiment classifiers
-
YOLOv6 Underwater Trash Detection Training Experiment
By
–
Hundreds of aquatic species are being negatively impacted by the increased under water trash deposits. This is a real problem. We recently ran an underwater trash detection training experiment using YOLOv6.
— Satya Mallick (@LearnOpenCV) 16 novembre 2022
Head over to our https://t.co/tSVje68CSR for the full read.#yolov6 #ai pic.twitter.com/vS6Ug105WJHundreds of aquatic species are being negatively impacted by the increased under water trash deposits. This is a real problem. We recently ran an underwater trash detection training experiment using YOLOv6.
Head over to our https://
learnopencv.com/yolov6-custom-
dataset-training/
… for the full read. #yolov6 #ai -
Hugging Face Releases 1.3T Parameter Mixture-of-Experts Model
By
–
We’ve heard mixture-of-experts (MoE) were in the air (GPT4??) so we’ve just added the first one in the transformers library for you to play with 🙂 With for nothing less than a 1.3 trillion parameters checkpoint model on the hub! The largest model on the hub at the moment
-
Hugging Face Hub and Gradio Democratizing Machine Learning Ecosystem
By
–
Will be live in an hour to talk about @huggingface hub, Gradio and how the entire ecosystem comes together to democratise ML.
-
Self-examination in AI science models for error detection
By
–
what would be cool with science models like Galactica would be to add self examination of the inputs like the coming Codex model, where the model can inspect it’s theorem proofs or essays and spot errors
-
Galactica: Open-Source Large Language Model for Science
By
–
Paper: https://
galactica.org/static/paper.p
df
…
Github: https://
github.com/paperswithcode
/galai
…
Demo: https://
galactica.org -
Galactica: 120B Scientific Language Model for Research
By
–
"Galactica" is a large scientific language model with 120B parameters, that can be used for a lot of tasks including
⦿ Predicting citations
⦿ Generating literature review
⦿ Generating molecules ⦿ Generating Jupiter notebooks etc.,