A Mathematical Theory of Communication By C. E. SHANNON
RESEARCH
-
Physics Laws as Master Algorithm: Intelligence Emergence
By
–
The laws of physics are the master algorithm: run them long enough and intelligence emerges.
-
Inductive Bias, Complete Data, and Causal Theories Recap
By
–
To recap:
– We always need prior assumptions/inductive biases, unless we have complete data (no free lunch theorem).
– If we have complete data, we don't need anything else for any rung.
– Causal theories are a type of inductive bias.
I guess that's a No answer to your question. -
Complete Data Includes Mental States and Counterfactual Questions
By
–
That's because the data is incomplete. Complete data includes the state of the actors' minds, and allows you to correctly answer counterfactual questions (which just correspond to different states of the world).
-
Incomplete Models: Action’s Role in Learning and Decision-Making
By
–
Those models are incomplete, because they don't include your actions. Convergence aside, and tautologically, if you know everything there's nothing left to learn. You can then make optimal decisions without causal assumptions.
-
Priors and inductive biases are equivalent concepts
By
–
Yes. (Again, priors and inductive biases are really the same thing.)
-
France strengthens mathematics to lead in AI and technology era
By
–
Première journée des Assises des Mathématiques, à Paris. Les mathématiques sont à la racine de toutes les sciences et permettent de modéliser la complexité. Alors que nous entrons dans une ère hautement technologique, il est vital que la France revienne à l’avant-garde.
-
Bio-Inspired Mole Crab Robots Developed at UC Berkeley
By
–
New research from Prof. Hannah Stuart @EDG_UCB on robots inspired by mole crabs!
-
MrsFormer: Multiresolution Attention Cuts Transformer Costs
By
–
‘MrsFormer’ Employs a Nove Multiresolution-Head Attention Mechanism to Cut Transformers’ Compute and Memory Costs https://
syncedreview.com/2022/11/14/mrs
former-employs-a-nove-multiresolution-head-attention-mechanism-to-cut-transformers-compute-and-memory-costs/
… -
AI and Supercomputing Convergence Reshapes Industry Landscape
By
–
The world of artificial intelligence drifts ever more into the domain of supercomputing, and both fields will be shaped by the interaction. // @cerebras // #artificialintelligence #deeplearning #machinelearning // $NVDA