6/ LLMs as General Pattern Machines – shows that without any additional training, LLMs are general sequence modelers, driven by in-context learning; applies 0-shot capabilities to robotics and transfer the pattern among words to actions.
AI
-
HyperDreamBooth: 25x Faster Personalized Text-to-Image Model
By
–
7/ HyperDreamBooth – introduces a smaller, faster, and more efficient version of Dreambooth; enables personalization of text-to-image diffusion model using a single input image, 25x faster than Dreambooth.
-
NaViT: Flexible Vision Transformer for Any Resolution
By
–
5/ Patch n’ Pack: NaViT – a vision transformer for any aspect ratio and resolution through sequence packing; enables flexible model usage, improved training efficiency, and transfers to tasks involving image and video classification among others.
-
Secrets of RLHF in LLMs: PPO Inner Workings Explained
By
–
3/ Secrets of RLHF in LLMs – takes a closer look at RLHF and explores the inner workings of PPO with code included.
-
LongLLaMA Extends Context Length via Contrastive Training
By
–
4/ LongLLaMA – employs a contrastive training process to enhance the structure of the (key, value) space to extend context length; presents a fine-tuned model that lengthens context and demonstrates improvements in long context tasks.
-
Can Generative AI Legally Hold Patent Rights?
By
–
The debate on AI, in this case Generative AI, being capable of invention in legal terms in particular the stents continues. I remain skeptical that the AI itself should be awarded patent rights as the AI model is not a legal person and we then get into issues about permission to
-
Synthetic surveying and personality simulation for customer development
By
–
A. Synthetic surveying / customer development is a cheaper alternative to doing the real thing, which is useful for ideation B. It makes customer development available even to people who don’t have large distribution C. The effective simulation of personality is a game changer
-
Social media essential for AI researchers and China watchers engagement
By
–
It’s a difficult choice. Unfortunately social media is pretty essential to my job – a lot of AI researchers and China watchers post original ideas & engage in unique debate on social media. I go where they go.
-
Debunking Five Common AI Myths and Misconceptions
By
–
Debunking AI Myths: The Truth Behind 5 Common #Misconceptions Unravel the enigma of #AI as this article busts five pervasive #myths, from #fears of robotic world domination to the mistaken belief in #machines' #unbiased judgment.
-
Writing Technical Books for LLMs Instead of Humans
By
–
I would still write books. I guess the difference is that I’d write them for LLMs rather than humans, who probably don’t need technical books anymore then