OPEN SOURCE

→ View original post on X — @poe_platform

Llama 2 Open Source Model for Flexible Bot Development

By

@poe_platform

–

01 September 2023 17h54

If you're creating a bot, this option gives you more flexibility in case the other models don't meet your needs. And since Llama 2 is open source, you don't have to worry about your bot changing behavior or the base model going away in the long term. (2/2)

Condor Galaxy 1 Powers BTLM and Jais Open-Source LLMs

By

–

01 September 2023 17h24

Condor Galaxy 1 (CG-1) was used to train BTLM, the top-performing open-source 3B parameter LLM. Now, CG-1 has been used to train Jais, the best open-source Arabic model. CG-1 is moving the open-source community forward. Contact us to train on CG-1 http://
cerebras.net/contact-us

→ View original post on X — @rasbt

CodeLlama PR merged with 4-bit quantization inference benchmarks

By

@rasbt

–

01 September 2023 14h30

The CodeLlama PR just got merged: https://
github.com/Lightning-AI/l
it-gpt/pull/472
… When I tried it with bnb's 4-bit Normal Float quantization, the 34B Instruct and Python variants used about 20 Gb for inference:

→ View original post on X — @abhi1thakur

Create Your Own AutoTrain Advanced Space and Train Models

By

@abhi1thakur

–

01 September 2023 11h16

Create your own AutoTrain Advanced Space and start training models!!!

JAIS Arabic Language Model Released with Paper and Demo

By

–

01 September 2023 0h54

Paper, sandbox, and model here: https://
arxiv.org/abs/2308.16149
#new_tab
… https://
arabic-gpt.ai https://
huggingface.co/inception-mbzu
ai/jais-13ba
…

→ View original post on X — @fchollet

Automated PyTorch Module Integration with Keras Layers

By

@fchollet

–

01 September 2023 0h52

By popular demand, we've automated the "turn the Module into a Keras Layer" step. So now you can just… use torch Modules in a Keras model/layer. No extra step needed. Just like you can use Keras models/layers as Modules.

Jais Open Source Model Achieves Claude-Level Performance at Fraction Size

By

–

01 September 2023 0h47

Compared to closed source models, Jais approaches Claude level performance. This is remarkable considering it’s ~10th the size of large closed models.

Jais Multilingual Model Outperforms Bloom and mT0

By

–

01 September 2023 0h47

In downstream evals, Jais easily tops the charts, beating prior open source models like Bloom and mT0. It’s easier to be good at two languages than 50!