This allows prototyping your own custom Chat UIs with multiple models options in few minutes.
SOFTWARE
-
OctoAI Simplifies Generative AI Production Deployment
By
–
Serving Generative AI just got a lot easier with OctoML's OctoAI Generative AI, because of its compute intensity, is especially hard to put into production. https://
zdnet.com/article/servin
g-generative-ai-just-got-a-lot-easier-with-octomls-octoai/
… @OctoML #AI #deeplearning #GenerativeAI -
Poe Adds Stop Button Feature for Web and iOS Apps
By
–
Poe now has a stop button for both web and iOS, so you can cut any bot off if you want to change your request without waiting for it to finish. iOS users may need to update to the latest release in the App Store to see the feature. Android support is coming soon.
-
Using 8 GPUs to reduce processing time to minutes
By
–
yes, you can of course use 8 GPUs to bring this down to a few minutes! 🙂
-
Google Lens detects skin conditions via smartphone
By
–
Starting today, Google Lens can detect skin conditions using the camera on your device. The image recognition model was trained on various conditions and provides visual matches of similar results. Question is: How long until your smartphone is an FDA approved medical device?
-
LoRA vs Adapter: Performance and Memory Usage Comparison
By
–
Good question! On average: LoRA: 21.33 tokens/sec; Memory used: 14.59 GB
Adapter: 26.22 tokens/sec; Memory used: 14.59 GB -
Efficient Falcon Finetuning with LoRA on Single GPU
By
–
Have been heads-down porting LoRA (low-rank-adaptation) to finetune Falcon more efficiently and ran some performance benchmarks. My longer write-up here: https://
lightning.ai/pages/communit
y/finetuning-falcon-efficiently/
… Long story short: you can finetune Falcon in 1 h on a 52k dataset using a single GPU with 16 GB RAM. -
Gmail’s New AI Feature Helps Write Emails on iOS Android
By
–
Article: https://
bgr.com/tech/gmails-ne
w-ai-feature-is-ready-to-help-you-write-emails-on-ios-and-android/
… -
Google Launches AI-Powered Help Me Write Feature in Gmail
By
–
Google is rolling out an AI-enabled “Help Me Write” function in Gmail. Am I going to have to start using Gmail again??
-
Zepz $5B Fintech Unicorn Plans M&A Push, New Wallet
By
–
New and exclusive: Zepz, the $5 billion fintech unicorn backed by Accel and TCV, is planning a big push on M&A and looking to roll out a new digital wallet product, hoping to move past the pain of laying off 26% of its workforce.