CODE

ML Evaluation Metrics and Lit-GPT Evaluation Framework

By

–

23 August 2023 14h10

I have a write-up explaining BLEU, ROUGE, and BERTScore in Chapter 19 of my ML Q and AI book: https://
leanpub.com/machine-learni
ng-q-and-ai/
… Other than that, Lit-GPT has currently the Eleuther AI Evaluation Harness implemented: https://
github.com/Lightning-AI/l
it-gpt/blob/main/tutorials/evaluation.md
…

Supported Models Toggle via Checkpoint Directory Flag

By

–

23 August 2023 14h08

Sure, the same code works for all supported models. You can toggle these via the –checkpoint_dir flag pointing to the directory where you downloaded the model. Here's a list of the currently supported models:

→ View original post on X — @mathworks

AI Enhances Low-Code Development for Code Mastery

By

@mathworks

–

23 August 2023 12h10

#AI: Your Partner for Code Mastery! Tune in to this podcast to uncover the benefits that Artificial Intelligence brings to low code http://
spr.ly/6018PlVUY #LowCode @EEJournalTFM

→ View original post on X — @julien_c

Python Integration in Spreadsheet Formula Bars

By

@julien_c

–

23 August 2023 9h54

So I haven’t looked at the Excel announcement at all, but what I would like is to be able to write python directly in the formula bar of the spreadsheet instead of their basic formula language

→ View original post on X — @miketamir

Exécuter Llama 2 sur Mac avec LLM et Homebrew

By

@miketamir

–

23 August 2023 3h01

Run Llama 2 on your own Mac using LLM and Homebrew https://
bit.ly/3KvLpcT #AI #MachineLearning #DeepLearning #LLMs #DataScience

Finetuning Llama 2 7B with Only 13 GB RAM on Single GPU

By

–

22 August 2023 23h54

I forgot to mention the probably most important thing: Finetuning Llama 2 7B this way – only requires 13 GB RAM – and can thus comfortably run on a single GPU

LoRA Quantization and Evaluation Scripts for Llama-2 Models

By

–

22 August 2023 23h32

Qualitatively, you can use python generate/lora.py –lora_path '… .pth' –quantize "bnb.nf4" –precision "bf16-true" –checkpoint_dir "…/Llama-2-7b-hf" Quantitatively, you can use the python eval/eval_harness scripts: https://
github.com/Lightning-AI/l
it-gpt/tree/main/eval
…

→ View original post on X — @predibase

Ludwig AI 0.8: Open-source LLM framework with fine-tuning

By

@predibase

–

22 August 2023 22h15

ICYMI: Last week we released @ludwig_ai 0.8—the first open-source, low-code framework optimized for efficiently building #custom #LLMs with your private data. Check out the webinar replay to see it in action including #finetuning: https://
pbase.ai/45jS7L8

QLoRA Single-GPU Limitations and Multi-GPU Future Plans

By

–

22 August 2023 19h33

QLoRA right now it's single-GPU. I left multi-GPU support as a future todo since I am currently mostly focused on the NeurIPS LLM challenge. But it might well be working with multi-GPU settings already; it's just that I haven't tested. Could be that it requires switching from