all info available in the model page: https://
huggingface.co/abhishek/autot
rain-llama3-orpo
… 🙂 finetuning took ~30 mins on 8xH100
CODE
-
Fast LLaMA 3 Fine-tuning with ORPO on 8xH100 GPUs
By
–
-
Mixing API and Local Models for Terminal Usage
By
–
If you want to mix API model and local model usage together, or use API models from the terminal generally
-
AutoTrain Fine-tuned Llama3 Outperforms Base Instruct Model
By
–
AutoTrain finetuned llama3 beats the base instruct model on all but one benchmark on the open llm leaderboard This model was finetuned using ORPO and is also publicly available. No code was written and all the setup took less than 10mins. `pip install autotrain-advanced`
-
Lightning Studio: Try AI Development Platform Today
By
–
Try it on a Lightning Studio: http://
Lightning.ai -
llm-gpt4all 0.4 Release Notes Published
By
–
Release notes for llm-gpt4all 0.4 are here: https://
github.com/simonw/llm-gpt
4all/releases/tag/0.4
… -
Llama 3 8B Now Available via llm-gpt4all Plugin
By
–
I upgraded the llm-gpt4all plugin to support running Llama 3 8B Instruct (thanks, @nomic_ai
) llm install –upgrade llm-gpt4all
llm -m Meta-Llama-3-8B-Instruct 'Write Python code to print 5 great names for a pet pelican' The quantized model is a 4.34GB download, needs 8GB RAM -
Flow Engineering Webinar Recording with LangChain Leaders
By
–
The recording from our Flow Engineering webinar with @hwchase17 and @itamar_mar is up! https://
youtube.com/watch?v=eBjxz7
qrNBs
… "Flow Engineering" is a term that has been gaining in popularity recently. The first time it was mentioned as term was in CodiumAI paper on AlphaCodium, where they -
Kernel optimization attempts yield minimal performance gains
By
–
added under kernel4 https://
github.com/karpathy/llm.c
/commit/cb791c4ef58d45d58e5af624b0ed41439ac7aeff
…
a bit surprised to only see ~1-2% out of it, which then washes out in training, as the layernorm is not a top-ranking time kernel. Also tried float4 and unrolling but that didn't improve it too much bleh -
PyTorch Pay-Per-Use Model Through Advanced Compiler Technology
By
–
I think some day, projects like PyTorch will make users pay only for the overhead they use. Lots of R&D needed to get there: compiler technology, type systems, various other things. Actually, LuaJIT was really cool in that aspect — one of the most brilliant pieces of
-
Perplexity API Coding Assistant Launches on VSCode
By
–
pplx-api powered coding assistant on VSCode! https://t.co/yAxeUMaOuB
— Aravind Srinivas (@AravSrinivas) 19 avril 2024pplx-api powered coding assistant on VSCode!