a movie about eliezer and liron traveling over half the world, to throw the gpu of power back into the tsmc, while being supported by jaan and max from up high; brought to you by veo3
TECHNOLOGY
-
AI Programming Languages: Optimizing Code for Model Exploration
By
–
It may be time to develop AI programming languages. Code generation must be optimized for guiding models in exploring solution space and ensuring correctness, not for human comprehension. Code specification must optimize synchronization between human intention and AI
-
Language Models Memory Capacity Scaling Laws Physics
By
–
Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws very interesting (if somewhat controversial) they declare that models, after visiting data 1000 times during training, can memorize 2 bits/param (they arrive at this number via quantization with AutoGPTQ)
-
Knowledge Storage Capacity in Language Model Parameters
By
–
How Much Knowledge Can You Pack Into the Parameters of a Language Model? enter, transformers- in 2020 these folks had a different idea: once "pretraining" is a thing, you can measure the amount of 'facts' that the model 'knows', without training it at all
-
RNN Capacity: 5 Bits Per Parameter Storage Empirical Analysis
By
–
Capacity and Trainability in Recurrent Neural Networks this very nice paper from 2016 (!) estimates certain types of RNNs can store 5 bits/param. they find this empirically and measure bits using the entropy of the distribution of class labels
-
Single-Layer Perceptron Memory Capacity Foundational Result
By
–
A foundational result in machine learning is that a single-layer perceptron with N^2 parameters can store at least 2 bits of information per parameter (Cover, 1965; Gardner, 1988; Baldi & Venkates) specifically: an MLP can memorize 2 N^2 things with only N^2 parameters
-
X Launches Encrypted Chat and Audio Video Call Features
By
–
New encrypted chat feature appears in X app, prior DMs still exist, but separately. Wonder if they will migrate message history or just delete when they fully migrate to this new chat. Noticed audio/video call settings too… (I think this is new?)
-
Flux Kontext AI Shows Impressive Photo Restoration Capabilities
By
–
C'est remarquable de voir à quel point la nouvelle IA Flux Kontext est performante dans le domaine de la restauration photo. Je vais sans doute en faire une vidéo.
-
Drone Warfare Technology Advances Faster Than Other Military Systems
By
–
Drone warfare is advancing far faster than any other military technology. The biggest breakthrough in decades.
-
AI advancement rivals entire digital revolution next decade
By
–
It fascinates me that RIGHT NOW – this exact moment – we're living through the most transformative decade in human history. The last 5 years saw AI advance more than computing did in its first 50 years. The next 10 years could rival the entire digital revolution from 1950