5️⃣ Lit-GPT

Lit-GPT is a fully open-source & hackable implementation of SOTA LLMs, it provides everything you need as an LLM Developer.

Key features include:

– Flash attention
– 4 & 8-bit quantization
– Finetuning using LoRA & LLaMA-adapter

Check this👇https://t.co/CVIb8IlJO5 pic.twitter.com/igAAS2FL7j

— Akshay 🚀 (@akshay_pachaar) 6 janvier 2024

Lit-GPT Lit-GPT is a fully open-source & hackable implementation of SOTA LLMs, it provides everything you need as an LLM Developer. Key features include: – Flash attention
– 4 & 8-bit quantization
– Finetuning using LoRA & LLaMA-adapter Check this https://
github.com/Lightning-AI/l
it-gpt
…

→ View original post on X — @akshay_pachaar