carbon dating ML papers by which open-source LM they use GPT-2 → the before times
GPT-J → summer 2022
LLAMA-1 → spring 2023
LLAMA-2 → summer 2023
mistral 7b → fall 2023
mixtral 8x7b → the current era
OPEN SOURCE
-
Carbon Dating ML Papers by Open-Source Language Models
By
–
-
Train SDXL LoRA Models with Replicate Web Form
By
–
https://
replicate.com/stability-ai/s
dxl/train
… You can train a Lora with a zip of images using the web form here There’s also a guide here: https://
replicate.com/guides/stable-
diffusion/fine-tuning#fine-tuning-sdxl-using-replicate
… -
Fine-Tuned LLMs: Zephyr, LoRAX, Ludwig Updates and More
By
–
Jan edition of our Fine-Tuned Newsletter: Fine-Tune #Zephyr for Cust Support @caveminds Podcast: Smaller Cheaper #Finetuned #LLMs Coding for non-coders OSS: Ludwig v0.9.3 / #LoRAX v0.6 Product: #Prompting fine-tuned #endpoints
…and more! https://
pbase.ai/3OprApB -
Teknium releases high-quality AI data filtering and curation
By
–
great release from @teknium
, doing a lot of high-quality data filtering and curating work, and opening it up. -
OpenGPTs YouTube Walkthrough: Hosted Version and Backend Code
By
–
OpenGPTs YouTube walkthrough A proper deep dive into OpenGPTs! Covers two main things: How to use the hosted version
Walkthrough of the code that powers the backend https://
youtube.com/watch?v=HAn9vn
Jy6S4
… -
Tenstorrent Open Sources TT-Metalium Kernel Software Stack
By
–
We're excited to announce that we have open sourced our kernel-level software stack, TT-Metalium. @ojoyoshida sat down with @DavidBennett__ and #tenstorrent fellow Jasmina Vasiljevic to talk #opensource, #software and our Grayskull DevKit https://
ojoyoshidareport.com/if-nvidia-is-a
i-hardwares-goliath-wheres-david/
… -
Early Access Model Leaked: Company Retrains from Llama 2
By
–
An over-enthusiastic employee of one of our early access customers leaked a quantised (and watermarked) version of an old model we trained and distributed quite openly. To quickly start working with a few selected customers, we retrained this model from Llama 2 the minute we got
-
OpenGPTs Updates: Open Source AI Model Control Tools
By
–
OpenGPTs Updates Some big updates to OpenGPTs! Reminder: OpenGPTs is an open source version of the GPT store where you can fully control the model used, the tools used, the retrieval strategy Blog + YouTube to dive into more detail! What are the updates? LangGraph:
-
Drupal Receives $300K Sustainable Funding for Security Projects
By
–
Drupal just celebrated its 23rd birthday! What better gift than sustainable open source funding? @sovtechfund has generously provided @drupalassoc $300,000 to fuel two crucial projects that promise to strengthen security for Drupal and enhance the Drupal ecosystem.
-
Community Manager Leaves Amplication After Developer Relations Role
By
–
Every good thing comes to an end! Today is my last day as a Community Manager at @amplication
. It was my first Developer Relations job and I worked on amazing things that impacted the wider open source developer community. Excited for the new adventures