Google Brain & Alberta U Paper Confirms the Computational Universality of Memory-Augmented Large Language Models https://
syncedreview.com/2023/01/18/goo
gle-brain-alberta-u-paper-confirms-the-computational-universality-of-memory-augmented-large-language-models/
…
AI
-
Memory-Augmented LLMs Achieve Computational Universality
By
–
-
Cross-attention in Transformer architecture article recommendation
By
–
nice article on cross-attention as supplementary too https://
vaclavkosar.com/ml/cross-atten
tion-in-transformer-architecture
… -
Clarification on Query and Key in Attention Mechanisms
By
–
nice, exactly! 🙂
(except you're swapping q's and k's – q is the query, the "what am i looking for", k is the key, the "what do i have", and in encoder-decoder the key,value from come from side. admittedly confusing because in dictionaries the _key_ is the "lookup" information.) -
Dark Side of AI: Data Labeling Outsourcing to Low-Cost Countries
By
–
Una triste historia que habla del lado oscuro de la IA donde las labores de etiquetados de datos (y en este caso concreto una labor que se vuelve horrible para el etiquetador) acaba siendo externalizada a países con costes laborales mucho más bajos.
-
Open Source Licensing: MIT and BSD as Practical Standards
By
–
Even a WTFPL is avoided; MIT or BSD, everything else is not worth the legal cost. (with the exception of that sqlite prayer instead of a license… sigh)
-
Tenstorrent Strengthens AI Hardware and RISC-V CPU Leadership
By
–
“Tenstorrent has both a differentiated AI hw and sw story, and a compelling #riscv #CPU roadmap. In the emerging era of chiplets, Tenstorrent is well positioned for success… @jimkxa and Ljubisa’s new roles are a natural fit. Thanks @karlfreund https://
forbes.com/sites/karlfreu
nd/2023/01/18/tenstorrent-shifts-leadership-roles/?sh=7b89cac7576a
… -
Tenstorrent Leadership Alignment Signals Strong Personal Commitment
By
–
“ It's a natural move … and based on my interactions with them this is clearly a personal relationship between the two, and not just a business one … it's clear that they both want to see the company succeed” Thanks @IanCutress https://
morethanmoore.substack.com/p/exclusive-al
ignment-for-tenstorrent
… -
Open Source Liability Concerns for Company Owners
By
–
So why open source it at all then? As company owner even having employees look at the code puts me into a certain liability.
-
GPL licensing impacts software commercialization and App Store submission
By
–
GPL affects everything, you can‘t really. Huge red flag if you ever wanna sell. Doubly true if you wanna submit in the App Store, GPL is incompatible with the restrictions Apple puts you on.
-
Empower Young Changemakers Through Technology Community
By
–
If you’re interested in empowering young thinkers, dreamers, changemakers & doers to uplift their communities through technology, join us in our journey by: Following us on social media Sharing our posts Donating on our website (7/7)