Paper, sandbox, and model here: https://
arxiv.org/abs/2308.16149
#new_tab
… https://
arabic-gpt.ai https://
huggingface.co/inception-mbzu
ai/jais-13ba
…
LLMS
-
JAIS Arabic Language Model Released with Paper and Demo
By
–
-
Jais Open Source Model Achieves Claude-Level Performance at Fraction Size
By
–
Compared to closed source models, Jais approaches Claude level performance. This is remarkable considering it’s ~10th the size of large closed models.
-
Cerebras-GPT: First External Customer AI Model Achievement
By
–
Jais was trained on the CG-1 AI supercomputer. We are super proud of the work we did on Cerebras-GPT and BTLM. This is the first time an external customer used our system to produce a world class model – another huge milestone for Cerebras!
-
Jais Multilingual Model Outperforms Bloom and mT0
By
–
In downstream evals, Jais easily tops the charts, beating prior open source models like Bloom and mT0. It’s easier to be good at two languages than 50!
-
Jais Model Combines Arabic and English Capabilities via Transfer Learning
By
–
In addition, Jais is trained on 278M English. This not only adds English capability, it also improves Arabic performance thanks to transfer learning. Knowing both languages makes the model super useful for locals and expats in the Middle East.
-
Building Arabic Language Models: Data Collection and Training Strategy
By
–
The key challenge of training any non-English model is data. To build a dataset large & rich enough for Arabic, Jais tapped into various open and curated sources totally 55B tokens. The model trained on 2 epochs of this data.
-
Jais-13B Bilingual Model Breakthrough Arabic English LLM
By
–
The Jais-13B model and paper is out! Jais is the world’s best *bilingual* model – fluent in Arabic & English. Here it’s casually negotiating for a lower rent. Let’s breakdown the paper
-
34B Parameter Models Now Run on Laptops, Massive Hardware Progress
By
–
Crazy how 34 billions parameters models seemed huge and unmanageable outside of a data center just maybe 1.5 years ago. Now it’s laptop stuff https://t.co/gXCg770BOM
— Thomas Wolf (@Thom_Wolf) 31 août 2023Crazy how 34 billions parameters models seemed huge and unmanageable outside of a data center just maybe 1.5 years ago. Now it’s laptop stuff
-
NLP-Powered Search and Discovery Now Available for Enterprises
By
–
Every enterprise I know needs this. Search is broken everywhere, especially keyword search. But NLP enabled search and discovery and summarization across all holdings in all languages is here now for those who want it:
-
Poe Platform Now Features Meta CodeLlama and Top LLMs
By
–
With @MetaAI's #CodeLlama models just added, https://t.co/WxZDDea4NR now has the most amazing collection of #LLMs around! 🔥
— Charly Wargnier (@DataChaz) 31 août 2023
✔️@OpenAI's #GPT3 & #GPT4 (incl. 32k!)
✔️@AnthropicAI's #Claude2
✔️@Google #PaLM
✔️@MetaAI's #Llama2 & #CodeLlama@poe_platform – web/iOS/Android/MacOS pic.twitter.com/gaYHsEoYMnWith @MetaAI
's #CodeLlama models just added, http://
poe.com now has the most amazing collection of #LLMs around! @OpenAI
's #GPT3 & #GPT4 (incl. 32k!) @AnthropicAI
's #Claude2 @Google #PaLM @MetaAI
's #Llama2 & #CodeLlama @poe_platform – web/iOS/Android/MacOS