Run Llama 2 on your own Mac using LLM and Homebrew https://
bit.ly/3KvLpcT #AI #MachineLearning #DeepLearning #LLMs #DataScience
OPEN SOURCE
-
Exécuter Llama 2 sur Mac avec LLM et Homebrew
By
–
-
Open Sourcing Prompts: The New Code Sharing Model
By
–
The idea of open sourcing prompts keeps coming up. @monkchips first clued me into the idea using Midjourney: you see and learn from others' prompts. If prompt engineering is a new way to code (as @mikeloukides has noted), then "open sourcing" prompts makes sense
-
Finetuning Llama 2 7B with Only 13 GB RAM on Single GPU
By
–
I forgot to mention the probably most important thing: Finetuning Llama 2 7B this way – only requires 13 GB RAM – and can thus comfortably run on a single GPU
-
LoRA Quantization and Evaluation Scripts for Llama-2 Models
By
–
Qualitatively, you can use python generate/lora.py –lora_path '… .pth' –quantize "bnb.nf4" –precision "bf16-true" –checkpoint_dir "…/Llama-2-7b-hf" Quantitatively, you can use the python eval/eval_harness scripts: https://
github.com/Lightning-AI/l
it-gpt/tree/main/eval
… -
Ludwig AI 0.8: Open-source LLM framework with fine-tuning
By
–
ICYMI: Last week we released @ludwig_ai 0.8—the first open-source, low-code framework optimized for efficiently building #custom #LLMs with your private data. Check out the webinar replay to see it in action including #finetuning: https://
pbase.ai/45jS7L8 -
GitHub Advocates for Enhanced Open-Source Support in EU AI Legislation
By
–
GitHub and others call for more open-source support in EU AI law https://
bit.ly/45gh0Hp
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
QLoRA Single-GPU Limitations and Multi-GPU Future Plans
By
–
QLoRA right now it's single-GPU. I left multi-GPU support as a future todo since I am currently mostly focused on the NeurIPS LLM challenge. But it might well be working with multi-GPU settings already; it's just that I haven't tested. Could be that it requires switching from
-
Meta’s SeamlessM4T Models Now Available on Hugging Face
By
–
The new SeamlessM4T models from @MetaAI are now available on Hugging Face! https://
huggingface.co/models?search=
facebook/seamless-m4t
… -
IDEFICS Model Playground Now Available on Hugging Face
By
–
Straight from the new IDEFICS model playground https://
huggingface.co/spaces/Hugging
FaceM4/idefics_playground
…
h/t @BrigitteTousi -
Meta Releases SeamlessM4T Translation Model Openly
By
–
We believe SeamlessM4T represents a significant breakthrough and as part of our open approach, today we're publicly releasing this work under a CC BY-NC 4.0 license so that others can continue to build on this important field of study. Get the code https://
bit.ly/3E4mtVZ