New open-source project tomorrow. Back to shipping on X.
OPEN SOURCE
-
AI21 and Databricks Slim Down LLMs with Open Source Models
By
–
AI21 and Databricks show open source can radically slim down AI Two new large language models, Jamba and DBRX, dramatically reduce the compute and memory needed for predictions, while meeting or beating the performance of top models such as GPT-3.5 and Llama 2.
-
Meta Prunes Llama 2 Model for Slimmer More Efficient AI
By
–
Meta's 'pruning' of Llama 2 model shows path to slimmer AI Half a neural network can be ripped away without affecting performance, thereby saving on memory needs. But there's bad news, too. https://
zdnet.com/article/metas-
pruning-of-llama-2-model-shows-path-to-slimmer-ai/
… @Meta @AIatMeta -
Shoutout to advocates for low resource languages and NLP
By
–
seriously shoutout to @dwhitena for consistently being on the side of low resource languages and the good work of @MasakhaneNLP (
https://
latent.space/p/practical-ai
-trends
…) – if any similar groups in latam/africa please make me aware of them -
Predibase Releases New Features Including A100 Training and Mistral Support
By
–
Exciting News: we shipped a brand new #release last week that’s packed with awesome features and improvements: All training jobs run on #A100's by default Mistral-7b-instruct-v0.2 now live for inference + #finetuning New #deployments UI And more:
-
Document accessibility in open source JavaScript components
By
–
Honestly, if an open source JavaScript component doesn't include this level of detail on the accessibility story I tend to assume they haven't put the work in So if you've done that work, please document it like this!
-
FOSS Culture Toxic Behavior Creates Security Vulnerabilities
By
–
One striking thing about the xz backdoor is how the uncool, mean standards of behavior common in FOSS, that many of us decried for years, & that many defended as authentic, tough, etc., ended up being not just exclusionary loser behavior, but a significant attack surface.
-
PostgreSQL Development: Reliable Database Technology Evolution
By
–
Yes, and it's very cool technology and developing at a solid pace – it's still pretty new though, the PostgreSQL options are a lot more boring (in a good way)
-
Ruff Python Linter: Simplicity and Performance Benefits
By
–
I really like Ruff these days for both simplicity and performance, looks like it has a rule for this https://
docs.astral.sh/ruff/rules/mut
able-argument-default/
… -
Mini-Jamba: 69M Parameter Scaled-Down LLM Released
By
–
Someone made Mini-Jamba, a 69M parameter, scaled-down version of Jamba for testing. Very cool.