In addition, Jais is trained on 278M English. This not only adds English capability, it also improves Arabic performance thanks to transfer learning. Knowing both languages makes the model super useful for locals and expats in the Middle East.
@cerebras
-
Jais-13B Bilingual Model Breakthrough Arabic English LLM
By
–
The Jais-13B model and paper is out! Jais is the world’s best *bilingual* model – fluent in Arabic & English. Here it’s casually negotiating for a lower rent. Let’s breakdown the paper
-
Arabic-English-Code Model Enables Multilingual Transfer Learning
By
–
(2/2) Training on an Arabic-English-Code dataset has allowed for transfer learning from English to Arabic and also from Arabic to English. Access the model on Hugging Face: https://
huggingface.co/inception-mbzu
ai
… -
Jais Arabic LLM Outperforms LLaMa 13B Efficiently
By
–
(1/2) Jais is the world's best-performing open-source Arabic language model. And in English, it performs as well as LLaMa 13B despite using a fraction of the training data and a fraction of the electricity to train. Contact us to learn more: http://
cerebras.net/contact-us -
Cerebras MBZUAI Develop Arabic-Optimized Language Model Techniques
By
–
(2/2) Researchers at Cerebras, Inception, and MBZUAI developed techniques to:
-Create a custom tokenization scheme optimized for Arabic -Identify the proper mix of English, Arabic, and code data -Augment Arabic tokens with machine-translations Models: https://
huggingface.co/inception-mbzu
ai
… -
Jais: Top-Performing Open-Source Arabic LLM Model
By
–
(1/2) Jais is the top-performing open-source Arabic LLM in the world. Better than Bloom, Llama, Falcon, etc. It is a 13B parameter model that was trained on a brand-new multilingual dataset. Read the technical paper: https://
inceptioniai.org/jais/docs/Tech
nicalpaper.pdf
… -
Jais: Advanced Arabic LLM Trained on Condor Galaxy 1
By
–
(3/3) Jais was trained on the newly unveiled Condor Galaxy 1 (CG-1) AI supercomputer, built by the G42 – Cerebras strategic partnership. To learn more, check out the Press Release: https://
cerebras.net/press-release/
meet-jais-the-worlds-most-advanced-arabic-large-language-model-open-sourced-by-g42s-inception
… -
New 13B Bilingual Arabic-English LLM Released Open Source
By
–
(2/3) Jais highlights:
-State-of-the-art 13B parameter bilingual Arabic-English LLM
-Trained on a new data set including 116 billion Arabic tokens and 279 billion English/code tokens -Bidirectional transfer learning
-Open source Model on Hugging Face: https://
huggingface.co/inception-mbzu
ai
… -
Jais: World’s Best Arabic Language Model Announced
By
–
(1/3) Cerebras, G42's Inception, and MBZUAI are pleased to announce Jais, the world’s best-performing Arabic LLM. Jais is a 13B parameter model that was trained on a new 395 billion token Arabic-English-Code dataset. Jais brings the power of Generative AI to 400m Arabic speakers
-
Women in Engineering: Director Shares Career and Education Perspectives
By
–
In her interview with @eetimes
, Director of Product, Natalia Vassilieva, shares her perspective on growing up in Russia, pursuing technical interests and obtaining her PhD, and her observations of women in engineering. Link: https://
eetimes.com/natalia-vassil
ieva-we-need-to-treat-ourselves-as-equal/
…