And 140K context on a single GPU. @ArtificialAnlys We look forward to seeing those benchmarks!
LLMS
-
Book fails to address linguistic meaning construction adequately
By
–
The book does not solve the problem it poses. It also does not concern itself with those cases where meaning can actually be constructed linguistically
-
LangFriend: Journal App with Long-Term Memory
By
–
LangFriend: a Journal with Long-Term Memory One of the concepts we are most interested in at LangChain is memory Whenever we are interested in a concept, we like to build an example app showing off that concept For memory, we decided to build a journaling app! We're
-
LLMs and Doctors: Collaboration Over Replacement in Medicine
By
–
“It’s no longer a question of whether LLMs will replace doctors in the clinic — they won’t — but how humans and machines will work together to make medicine better for everyone,” says @Stanford CERC researcher Ethan Goh.
-
Full Fine-Tuning vs Other Methods: Overfitting Prevention
By
–
Not necessarily. Done right, full fine-tuning is usually better… my assumption for why this prevents overfitting is it’s not really affecting the parameters as much as a FT. Total speculation, I may be wrong.
-
LoRA QLoRA Fine-tuning Prevents Overfitting Better
By
–
While LoRA/QLoRA isn’t as powerful as full fine-tuning, it often can prevent overfitting from suboptimal tuning
-
Microsoft Expands AI Model Availability on Hugging Face Platform
By
–
They do a bit already: https://
huggingface.co/microsoft but let's for more! -
Mistral 7B Extended Context Training and Dataset Improvements
By
–
On the model side, longer context length for the 7B! If you could train over the new Mistral 7B w/ 32K that’d be awesome. As for the dataset, I haven’t found many issues with it 🙂
-
Abacus AI Case Studies: Enterprise-Scale Machine Learning Platform
By
–
Explore @AbacusAI Case Studies — see how their #AI platform handles all aspects of #MachineLearning & #DeepLearning at enterprise scale: https://
abacus.ai/casestudies #DataScience #PredictiveAnalytics #AnomalyDetection #ComputerVision #LLMs #LLMOps #MLOps https://
abacus.ai/about -
AI as Text Synthesizer: Burroughs Cut-Up Technique at Scale
By
–
AI as word synthezier for arrt? Its the cut-up technique of Burroughs at massive scale.