I chatted to the Hugging Face folks and they tell me an official fix for this performance issue is on the way! 😀 So hopefully my hacky workaround will be redundant soon…
CODE
-
PEFT Kaiming Init Optimization Patch for Training
By
–
The issue is that PEFT spends all that time doing unnecessarily doing kaiming init. So our code first patches the `init` module so that `kaiming_uniform_` does nothing at all. Here's a gist with the full code:
-
Python contextlib.contextmanager decorator explained
By
–
BTW this is a great example of the use of the handy `contextlib.contextmanager` decorator. Check out the docs if you haven't used it before: https://
docs.python.org/3/library/cont
extlib.html#contextlib.contextmanager
… -
Speed up Hugging Face PEFT model initialization with this trick
By
–
If you use @huggingface PEFT, then you'll have noticed that calling `get_peft_model` is *really* slow… However, you can make it nearly instant by running this magic snippet first!
-
Software Engineering Best Practices for Data Scientists
By
–
Software Engineering for Data Scientists https://
bit.ly/3rhXdsD #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Poe Releases Bot Development Documentation for Developers
By
–
If you are interested in building a bot, you can see our documentation at http://
developer.poe.com. We’re excited to see what everyone builds on top of this and will continue to do our best to support all of you! -
Poe Launches Image Rendering API for Bot Image Generation
By
–
The other major improvement launching today is the ability to return images from a bot, and have Poe clients render them as first-class objects, as shown in SDXLx3 above, and in the StableDiffusionXL bot launched last week, which is also built entirely on this same API.
-
Poe Hosts Online Hackathon for AI Bot Developers
By
–
We will be hosting an online hackathon for all developers to build on these improvements this Saturday 10/7. We’ll have support available from the Poe team and $10k in prizes for the best bots. More information here: https://
developer.poe.com/resources/poe-
hackathon-1-10-7
… -
Poe Launches Developer Features for Chat AI Products
By
–
These launches today are an important step toward our goal to make Poe the easiest way to build a chat-based AI product and get it to a mass audience. We have a few more key features for developers we will be launching soon to continue to unlock the potential of the platform.
-
Build Custom Bots with Multiple AI Models
By
–
You can call any combination of these to build your bot, and we will continue to work with all of the leading AI research organizations to add new models as they are created. Examples: