A lot of agent toolkits were mostly designed to work with normal LLMs, not chat models But chat models are newer, faster, and generally better We're working on making all our agent toolkits usable with these chat models, s/o @fpingham for doing the first four!
TOOLS
-
OctoAI Simplifies Generative AI Production Deployment
By
–
Serving Generative AI just got a lot easier with OctoML's OctoAI Generative AI, because of its compute intensity, is especially hard to put into production. https://
zdnet.com/article/servin
g-generative-ai-just-got-a-lot-easier-with-octomls-octoai/
… @OctoML #AI #deeplearning #GenerativeAI -
LoRA vs Adapter: Performance and Memory Usage Comparison
By
–
Good question! On average: LoRA: 21.33 tokens/sec; Memory used: 14.59 GB
Adapter: 26.22 tokens/sec; Memory used: 14.59 GB -
Memory reduction: Full finetuning vs Adapter vs LoRA comparison
By
–
Btw, it's also a big reduction in memory: 16 gigs instead of 6 x 40 GB. Due to the reduced parameter counts in the backward pass: Full finetuning: 7,217,189,760
Adapter: 1,365,330
Adapter v2: 3,839,186
LoRA: 3,506,176 (I used LoRA rank of 16 to match Adapter v2 above.) -
GPT Engineer Setup Guide and Demo
By
–
GPT Engineer is pretty crazy… Here's how you set it up: https://t.co/DhAPQSE14i pic.twitter.com/d5N9ITvaYJ
— Dave Ebbelaar (@daveebbelaar) 15 juin 2023GPT Engineer is pretty crazy… Here's how you set it up: https://
youtu.be/gWy-pJ2ofEM -
Efficient Falcon Finetuning with LoRA on Single GPU
By
–
Have been heads-down porting LoRA (low-rank-adaptation) to finetune Falcon more efficiently and ran some performance benchmarks. My longer write-up here: https://
lightning.ai/pages/communit
y/finetuning-falcon-efficiently/
… Long story short: you can finetune Falcon in 1 h on a 52k dataset using a single GPU with 16 GB RAM. -
Gmail’s New AI Feature Helps Write Emails on iOS Android
By
–
Article: https://
bgr.com/tech/gmails-ne
w-ai-feature-is-ready-to-help-you-write-emails-on-ios-and-android/
… -
Google Launches AI-Powered Help Me Write Feature in Gmail
By
–
Google is rolling out an AI-enabled “Help Me Write” function in Gmail. Am I going to have to start using Gmail again??
-
MS Excel: Effective Tool for Data Silo Management
By
–
MS Excel has definitely presented itself as an effective computational tool for working with data silos. Want to get adept with various MS Excel resources? #ResourceWatch #data #datascience #algorithms
-
AlphaCTR: New AI Tool Launches on Product Hunt
By
–
We're on PH. Help us out here if you have 30 seconds! https://
producthunt.com/posts/alphactr