We show that position interpolation works just as well in the context of ALiBi – models trained with 8K of context can now extrapolate up to 16K.
CODE
-
Tool Extensibility for AI Copilot Plugins in Creative Software
By
–
Yeah – it's easy to hack prototypes together but most tools seem too closed for this. IDEs have the benefit of being highly extensible with plugins. Maybe something like Blender is a good candidate for community copilot plugins, but something like Ableton seems difficult.
-
Targeted AI Use for Code Refactoring and Performance Optimization
By
–
I use it for specific, targeted questions. Eg: refactoring a block of code, improving performance of some function, how to do something specific. For questions that require more information I give it general context and ask about approaches at a high level.
-
GPT Pilot: AI-Powered Development Tool Speeds App Creation 20x
By
–
GPT Pilot – a dev tool that speeds up app development by 20x https://
bit.ly/3Pvy9Xs #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Fine-tuning LLMs: Local Communities and Development Resources
By
–
I don't find much great info on *doing* fine-tuning at r/localllama, but I find the info there on *using* fine-tunes really great. The folks that create the tunes that r/localllama do their development in the open on various discords (e.g. alignment labs, nous, skunkworks)
-
Glassdoor Launches ML Registry for Artifact Management
By
–
Introducing Glassdoor’s ML Registry: A Centralized Artifact Management Solution https://
bit.ly/46jQJZl #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Unicode Challenges in Development Still Puzzling
By
–
still haven't gotten over the Unicode aspect lol
-
ChatGPT: Building Software Engineering and Business Success
By
–
ChatGPT can help you become a world class software engineer, build companies, etc. The upside is might greater than $1M in certain situations. Of course, you still have to do the work.
-
Using Standard Vision Model Encoders for Your Projects
By
–
For the encoder just use whatever works for your normal vision models I think.