Any sense of how deep these betting markets are in aggregate? If someone didn't care about making money on the betting market but just wanted to manipulate the current appearance of results, how much money would that take?
@jeffdean
-
Waymo autonomous vehicles expanding to more locations soon
By
–
Waymo cars on the road in more places soon! https://t.co/JgxEBsP8ag
— Jeff Dean (@JeffDean) 25 octobre 2024Waymo cars on the road in more places soon!
-
bfloat16 floating point format TPUv2 hardware design
By
–
I didn't come up with the name. I called it 'CompactFloat', if I remember correctly. The bfloat16 moniker was given later by some folks in our early TPUv2 hardware team when they were exploring 16-bit floating point formats, to distinguish it from the IEEE fp16 format (that
-
Neural Network Training Noise Tolerance Asynchronous Updates
By
–
Some intuition, some luck. We already knew that neural net training was very tolerant of noise (we were doing asynchronous updates from dozens of replicas to train large models, which added lots of noise to the updates). Noise is ~ the least important bits, so I said "well, I'd
-
Gemini’s Extended Context Window Capability
By
–
Gemini's long context window is something to crow about!
-
Evolved Transformer uses 25% less energy than standard models
By
–
The last few rows of Table 1 in https://
arxiv.org/abs/2104.10350 report effect of this on energy usage and CO2e emissions: the more accurate Evolved Transformer (Medium) model uses 25% less energy to train on TPUv2 than does the Transformer (Big) model (& similar story on P100 GPUs) -
Evolved Transformer Achieves Better BLEU Score With 37.6% Fewer Parameters
By
–
See Figure 4 in section 5.3 of So et al (
https://
arxiv.org/abs/1901.11117) In the figure, for example, the second-to-last red dot (Evolved Transformer) achieves a higher BLEU score than the last and largest blue dot configuration (plain vanilla transformer) & has 37.6% fewer parameters. -
Powering AI clusters with renewable and nuclear energy sources
By
–
Gas generators aren't the only option. Presumably wind, solar or nuclear could be great options to power such a cluster. And taxes with the appropriate pricing of negative externalities might help shift the choice towards something with a cleaner firm of energy.
-
States implement new wealth taxes amid economic policy debate
By
–
The linked article by @doctorow is full of early results of various states' new taxes aimed at extremely wealthy individuals. Also, it reminds us that top tax rates in the US were 94% and 70%, during unprecedented economic expansion in the US.
-
Google Signs First Corporate Nuclear Energy Agreement with Kairos Power
By
–
Today, @Google signed the world’s first corporate agreement to purchase nuclear energy from a series of small modular reactors, to be developed by @KairosPower
. Learn how this will help bring new 24×7 clean power to the US electricity system.