Yes, it's an optional feature. It uses FlashAttention by default, but you can optionally use FlashAttention 2 via pip install 'flash-attn>=2.0.0.post1' –no-build-isolation
OPEN SOURCE
-
Stable Diffusion Anniversary: One Year of Generative AI Innovation
By
–
One year ago, we co-released @StableDiffusion
! It has enabled countless creative applications over this past year, opening up new possibilities for the future of generative AI. Since then, we've also released 36 models for public access, including SD 2.x, SDXL, StableLM, etc. -
QLoRA Support Added to Lit-GPT for All LLM Models
By
–
Just added QLoRA support for all LLMs in Lit-GPT: Llama 2, Falcon, Pythia, StableLM, and all others! You can use it via `python finetune/lora.py –quantize "bnb.nf4"` to save significant GPU memory. I've ran a few more benchmarks on the Gh PR here: https://
github.com/Lightning-AI/l
it-gpt/pull/275
… -
Camenduru Returns with AI WebUI Tool Under Organization
By
–
.
@camenduru is back under an org we are bracing for even more virality https://
huggingface.co/spaces/camendu
ru-com/webui
… -
Amazon Textract Integration for LangChain PDF Loading
By
–
Amazon Textract Integration Loading PDFs has been one of the biggest areas of questions for folks using LangChain to connect to their data That's why I'm excited to highlight our recently-added integration with Amazon Textract https://
python.langchain.com/docs/integrati
ons/document_loaders/pdf-amazonTextractPDFLoader
… -
Open Source Cloud Collaborations: Following the Money Trail
By
–
Wondering if OpenELA, OpenTF, or other open source corporate collaborations will work? Follow the cloud money https://
infoworld.com/article/370509
4/follow-the-cloud-money.html
… by @mjasay for @InfoWorld -
Llama2 Finetuned Models Now Available as Predicted
By
–
Llama2 finetunes are here as predicted on the pod
-
LangSmith RAG Testing Webinar and Evaluation Cookbook
By
–
RAG Evaluation Webinar Last week @WHinthorn added a fantastic cookbook using LangSmith to test RAG systems: https://
github.com/langchain-ai/l
angsmith-cookbook/blob/main/testing-examples/qa-correctness/qa-correctness.ipynb
… Come listen to him talk about this (and more) during our evaluation webinar next week! Register for the webinar here: -
SAS Explore Conference: Data Analytics, AI and Open Source Networking
By
–
Data is at the heart of everything we do 📈. You too, can be at the center by experiencing everything data analytics, open source, #AI & lots of networking at SAS Explore.
— SAS Software (@SASsoftware) 19 août 2023
Registration is open, business analysts! Get ahead, and stay ahead 👉 https://t.co/X3CEw8z6OU #ExploreSAS pic.twitter.com/QnFzP5yelJData is at the heart of everything we do . You too, can be at the center by experiencing everything data analytics, open source, #AI & lots of networking at SAS Explore. Registration is open, business analysts! Get ahead, and stay ahead http://
2.sas.com/6015Pimrt #ExploreSAS -
NeurIPS 2023 LLM Efficiency Challenge Quickstart Guide
By
–
Interested in the NeurIPS 2023 LLM Efficiency Challenge or just training your custom LLM on 1 GPU? Wrote a new quickstart guide to get started in ~5 min: https://
github.com/Lightning-AI/l
it-gpt/blob/main/tutorials/neurips_challenge_quickstart.md
… If there's interest, also happy to write an article w. research directions to explore. Let me know!