The @googlecloud MultiSlice system (see blog post in tweet below) is an external version of some internal software+hardware we've been using for a while to scale some of our largest ML training runs across multiple TPUv4 and TPUv5e pods. Scaling made easy!
RESEARCH
-
Stanford’s CRAFT: AI Education Resources for K12 Students
By
–
School is back in session. What should K12 students know about AI? @Stanford and AI experts teamed up with teachers to create CRAFT, which offers public curricular resources for teaching AI. https://
stanford.io/45QvSfJ -
BART Abstractive Text Summarization with KerasNLP and Keras Core
By
–
Abstractive text summarization with BART — using KerasNLP and Keras Core, with JAX
-
Full Finetuning Missing from Parameter-Efficient Techniques Comparison
By
–
That's a really nice figure! I would say in addition to all the parameter-efficient finetuning techniques, one category that is missing is full finetuning. That is, just training the model as is without PEFT.
-
Community should adopt ‘finetuning’ over ‘fine-tuning’ terminology
By
–
That's a nice summary! Hah, one personal pet-peeve: I hope the community is moving from "fine-tuning" to "finetuning" similar to what happened to pretraining 😛
-
Arabic-English-Code Model Enables Multilingual Transfer Learning
By
–
(2/2) Training on an Arabic-English-Code dataset has allowed for transfer learning from English to Arabic and also from Arabic to English. Access the model on Hugging Face: https://
huggingface.co/inception-mbzu
ai
… -
WizMap: Interactive Embedding Visualization for Large Language Models
By
–
GitHub – poloclub/wizmap: Explore and interpret large embeddings in your browser with interactive visualization! https://
bit.ly/3Qvp2Iq #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Three Waves of Technology: From Atoms to Bits to New Forms
By
–
"Translated into terms of technological waves, Suleyman’s evolutionary sequence looks like this: humans first used technology to operate on the physical world – the world of atoms; then they worked on bits, the units of information; and now they are working on creating new forms
-
AI-Powered Genomics: Lovelace Institute Study Insights
By
–
Some insights on AI powered genomics from a Lovelace Institute study and some GPT queries: AI-powered Genomics https://
oodaloop.com/archive/2023/0
8/31/ai-powered-genomics/
… via @ooda