(2/2) Training on an Arabic-English-Code dataset has allowed for transfer learning from English to Arabic and also from Arabic to English. Access the model on Hugging Face: https://
huggingface.co/inception-mbzu
ai
…
@cerebras
-
Arabic-English-Code Model Enables Multilingual Transfer Learning
By
–
-
Jais Arabic LLM Outperforms LLaMa 13B Efficiently
By
–
(1/2) Jais is the world's best-performing open-source Arabic language model. And in English, it performs as well as LLaMa 13B despite using a fraction of the training data and a fraction of the electricity to train. Contact us to learn more: http://
cerebras.net/contact-us -
Cerebras MBZUAI Develop Arabic-Optimized Language Model Techniques
By
–
(2/2) Researchers at Cerebras, Inception, and MBZUAI developed techniques to:
-Create a custom tokenization scheme optimized for Arabic -Identify the proper mix of English, Arabic, and code data -Augment Arabic tokens with machine-translations Models: https://
huggingface.co/inception-mbzu
ai
… -
Jais: Top-Performing Open-Source Arabic LLM Model
By
–
(1/2) Jais is the top-performing open-source Arabic LLM in the world. Better than Bloom, Llama, Falcon, etc. It is a 13B parameter model that was trained on a brand-new multilingual dataset. Read the technical paper: https://
inceptioniai.org/jais/docs/Tech
nicalpaper.pdf
… -
Jais: Advanced Arabic LLM Trained on Condor Galaxy 1
By
–
(3/3) Jais was trained on the newly unveiled Condor Galaxy 1 (CG-1) AI supercomputer, built by the G42 – Cerebras strategic partnership. To learn more, check out the Press Release: https://
cerebras.net/press-release/
meet-jais-the-worlds-most-advanced-arabic-large-language-model-open-sourced-by-g42s-inception
… -
New 13B Bilingual Arabic-English LLM Released Open Source
By
–
(2/3) Jais highlights:
-State-of-the-art 13B parameter bilingual Arabic-English LLM
-Trained on a new data set including 116 billion Arabic tokens and 279 billion English/code tokens -Bidirectional transfer learning
-Open source Model on Hugging Face: https://
huggingface.co/inception-mbzu
ai
… -
Jais: World’s Best Arabic Language Model Announced
By
–
(1/3) Cerebras, G42's Inception, and MBZUAI are pleased to announce Jais, the world’s best-performing Arabic LLM. Jais is a 13B parameter model that was trained on a new 395 billion token Arabic-English-Code dataset. Jais brings the power of Generative AI to 400m Arabic speakers
-
Women in Engineering: Director Shares Career and Education Perspectives
By
–
In her interview with @eetimes
, Director of Product, Natalia Vassilieva, shares her perspective on growing up in Russia, pursuing technical interests and obtaining her PhD, and her observations of women in engineering. Link: https://
eetimes.com/natalia-vassil
ieva-we-need-to-treat-ourselves-as-equal/
… -
Cerebras Announces MemoryX and SwarmX Technologies for AI Hardware
By
–
(2/2) This includes MemoryX, our external store for trillions of model weights, and SwarmX, our interconnect technology to connect hundreds of CS-2s and MemoryX. Register to attend HotChips in person or online here: https://
hotchips.org/registration/ -
Cerebras Chief Architect Shares Wafer-Scale Cluster Design Details
By
–
(1/2) Cerebras’ Chief Hardware Architect, Sean Lie, will present at @hotchipsorg on Tuesday, August 29th at 10:30 am For the first time, Sean will share design details of the Cerebras Wafer-Scale Cluster, including a deep dive into the components besides the Cerebras CS-2.