Talking with Neuralink engineers about long term implanted device reliability, operating in the brain was likened to operated in heated seawater for years, which does sound challenging!
@id_aa_carmack
-
GPU Heat and Noise Issues Require Laundry Room Setup
By
–
I considered it still too hot and noisy to be in the same room with. I probably need to put a rack in the laundry room if I still want ML GPUs now.
-
DGX Station Failure and Hardware Redundancy Considerations
By
–
Still very happy with our @LambdaAPI cluster, so my personal DGX station dying isn’t critical path, but I liked having some redundancy in capabilities. I sometimes think about the merit of having a stockpile of physical hardware in case something crazy happens in the volatile AI
-
DGX Station Repeatedly Fails: Third Hardware Issue in Months
By
–
My DGX Station https://
nvidia.com/content/dam/en
-zz/Solutions/Data-Center/dgx-station/dgx-station-data-science-supercomputer-datasheet-v4.pdf
… died AGAIN and Nvidia is again shipping me a replacement unit. First was a cooling pump, then an NVLINK failure, now a CPU overheat. Good service, but a lemon of a $150k product. -
High-speed tensor core inference with massive memory bandwidth
By
–
So, you have a 200 TB/s fire hose of recycling information, which you would have to “pump up” over many cycles from much slower conventional memory, but it could then feed straight in to a field of tensor core registers for real time model inference. Fun to think about!
-
AI Models Trading Latency for Bandwidth Using Delay Line Memory
By
–
Last month I commented about how AI models could trade latency for bandwidth in memory systems. Some ancient computers used acoustic delay lines for memory: https://
en.m.wikipedia.org/wiki/Delay-lin
e_memory
… Surprisingly, a fiber optic delay line memory is not completely absurd today! -
Rejection of Bengio’s AI Regulation and Certification Proposals
By
–
“Bengio called for governments to register AI developers and govern them similarly to pharmaceutical companies and aircraft manufacturers. He also proposed that computer scientists should be required to undergo ethical training and certification.” Umm, no. Hell no.
-
Media Bias and Misleading Coverage of Geoffrey Hinton’s Statements
By
–
I chuckled a bit at @geoffreyhinton being a little miffed about some of misleading bias in the media handling of his statements. Firsthand experience with that should cause you to update a whole lot of priors in your entire worldview that has been shaped by the media.
-
Pressure mounting on Yann LeCun to make alarmist statements
By
–
The pressure to get @ylecun to join in and say something alarmist is going to be intense!
-
Real-time performance challenges in multi-thousand GPU clusters
By
–
Is anyone doing real time work on the multi-thousand GPU clusters that are popping up? It should be possible with the right software, but I generally see step times measured in seconds rather than milliseconds.