Dropout layers in a Transformer leak the phase bit (train/eval) – small example. So an LLM may be able to determine if it is being trained and if backward pass follows. Clear intuitively but good to see, and interesting to think through repercussions of
GENERATIVE AI
-
Which sectors are working with OpenAI
By
–
Which sectors are working with OpenAI?
by Felix Richter @wef Learn more: https://
buff.ly/3lueGeh #AI #ArtificialIntelligence #MI #DataScience #Robotics #Tech #Technology #Healthcare cc: @wil_bielert @patrickgunz_ch @terenceleungsf -
State-of-the-Art Deep Learning Models for Unstructured Text Analysis
By
–
Over the years, we've built many state-of-art Deep Learning models. Today, you can use them to get insights from unstructured text. And the best part: We cover your solution end-to-end. Bring your data, and we do the rest!
-
Conversational AI Building Experiential Foundation in Metaverse
By
–
Into the metaverse: How conversational #AI will build its experiential foundation
by @rajkoneru @VentureBeat Go to: https://
buff.ly/3xodMTt #Digital #BigData #ArtificialIntelligence #MI #Blockchain cc: @wil_bielert @patrickgunz_ch @terenceleungsf -
AI Automation Impact on Employment in Regulated Sectors
By
–
b) Universal Basic Income already exists in the form of employment in the regulated sectors c) Even if some jobs in the unregulated sectors are lost to AI automation, there may still be opportunities for job growth in the highly regulated sectors. 2/2
-
14 Best Use Cases for ChatGPT Explained
By
–
The Best Examples of What You Can Do With ChatGPT #ChatGPT is all the rage in online circles…but what exactly can you use it for? Here are my top 14 #examples.
-
GigaGAN: Scaling GANs for Fast High-Resolution Image Synthesis
By
–
10/ GigaGAN – enables scaling up GANs on large datasets for text-to-image synthesis; it’s found to be orders of magnitude faster at inference time, synthesizes high-resolution images, & supports various latent space editing applications.
-
Foundation Models for Decision Making: Tools and Methods
By
–
6/ Foundation Models for Decision Making – provides an overview of foundation models for decision making, including tools, methods, and new research directions.
-
Hyena Hierarchy: Subquadratic Attention Replacement for LLMs
By
–
7/ Hyena Hierarchy – a subquadratic drop-in replacement for attention; it interleaves implicit long convolutions and data-controlled gating and can learn on sequences 10x longer and up to 100x faster than optimized attention.
-
A History of Generative AI: From GAN to ChatGPT
By
–
4/ A History of Generative AI – an overview of generative AI – from GAN to ChatGPT.