Just arrived in Austin and looking forward to attending SciPy once more! Ready and excited for my workshop on “Modern Deep Learning with PyTorch” tomorrow! https://
github.com/rasbt/scipy202
3-deeplearning
…
OPEN SOURCE
-
Sebastian Raschka Arrives in Austin for SciPy Conference Workshop
By
–
-
Humble approach to long context lengths with minimal finetuning
By
–
This sounds a bit more humble than the recent 1M or 1B context lengths claims. But this requires only minimal (1000 steps) finetuning. And it allows long document summarization using LLaMA 7B and 65B models, for example. Link to the paper here: https://
arxiv.org/abs/2306.15595 3/3 -
Upload Model Weights to Hugging Face Community Hub
By
–
Please consider uploading the weights to http://
hf.co -
Open Source LLM App Ideas Community Showcase
By
–
We can't wait to see what you build with it. "Give me some ideas for apps that can be built with an open source LLM."
-
Impressive Open Source LLM Performance with Creative Poetry Generation
By
–
The results are very impressive. You can quickly see why it's the best performing open source LLM. "Write a poem about open source machine learning in the style of Byron."
-
Falcon-40b-instruct Tops OpenLLM Leaderboard Rankings
By
–
Falcon-40b-instruct is the top performing model on the OpenLLM leaderboard. Built by @TIIuae
, it's free to use for commercial and research use. https://
huggingface.co/spaces/Hugging
FaceH4/open_llm_leaderboard
… -
Stability AI Advocates for Open Models in AI Senate Oversight
By
–
Advocating for Open Models in AI Oversight: Stability AI's Letter to the United States Senate — Stability AI https://
bit.ly/42TPdvv #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Red Hat CentOS Controversy: Vendor Dominance in Linux
By
–
I'm writing another post on the Red Hat CentOS "controversy," and reading some of my old posts. I used to be much snarkier in my writing. To wit… https://
cnet.com/culture/novell
-calls-for-linux-standard-isv-certification-forgets-that-its-called-red-hat/
… https://
cnet.com/culture/ibm-sl
eeps-over-at-suns-house-tries-to-keep-red-hat-in-its-place/
… https://
readwrite.com/openstack-need
s-a-dominant-vendor-not-interoperability/
… -
Roberta-Large and Decoder-Style LLMs Comparison
By
–
I would consider Roberta-Large (see above) an LLM. But you are also welcome to swap that with decoder-style LLMs. I have a BLOOM (GPT-3 equivalent) example here: