Excellent overview/pointers for "Large Transformer Model Inference Optimization" techniques (and blog more generally).
SOFTWARE
-
LLM Demos: Replit Starter and Google Calendar Integration
By
–
Wanted to share two demos that we're really excited about! @Replit starter example by @alanaagoyal (makes it easy to get started on Replit) https://
x.com/alanaagoyal/st
atus/1615455535779971072?s=20&t=pXZn1k9HcmfcRAI-Yt0F9w
… GCal integration by @nickscamara_ – LLMs can now control your calendar -
Accelerate Open Source Library Surpasses 10 Million Downloads
By
–
Accelerate just surpassed 10 million downloads! Whether used to train on large compute or deployed on small compute,Accelerate is everywhere! Learn more at http://
hf.co/docs/accelerate -
Feature lacks API and notification integration for support workflows
By
–
Terrible feature IMO. No API. No notifications. Unable to integrate into existing support workflows.
-
Git Cheat Sheet: Essential Commands for Version Control
By
–
Source: https://
datacamp.com/cheat-sheet/gi
t-cheat-sheet
… -
Word Processors Will Soon Block Harmful Language
By
–
Soon, word processors won’t let you type harmful words.
-
Tenstorrent Strengthens AI Hardware and RISC-V CPU Leadership
By
–
“Tenstorrent has both a differentiated AI hw and sw story, and a compelling #riscv #CPU roadmap. In the emerging era of chiplets, Tenstorrent is well positioned for success… @jimkxa and Ljubisa’s new roles are a natural fit. Thanks @karlfreund https://
forbes.com/sites/karlfreu
nd/2023/01/18/tenstorrent-shifts-leadership-roles/?sh=7b89cac7576a
… -
GPL licensing impacts software commercialization and App Store submission
By
–
GPL affects everything, you can‘t really. Huge red flag if you ever wanna sell. Doubly true if you wanna submit in the App Store, GPL is incompatible with the restrictions Apple puts you on.
-
Developer Returns to Open-Source Coding Roots
By
–
In part but I’m mostly going back to my open-source coding roots