And an overview of how ZerO initialization can overcome degeneracy by using Hadamard transforms for rectangular weight matrices
RESEARCH
-
ZerO Initialization: Neural Networks with Only Zeros and Ones
By
–
ZerO Initialization: Initializing Neural Networks with only Zeros and Ones A fully deterministic initialization scheme which sets the weights to only 0s and 1s can achieve SOTA on various datasets including ImageNet. Maybe random weights are unnecessary. https://
openreview.net/forum?id=1AxQp
KmiTc
… -
Data Quality Critical: Flawed Input Ruins AI Systems
By
–
Y'all know my #AI trinity: chicken (algorithm), eggs (data), & bacon (objective). Here's an example of rotten eggs: https://
bit.ly/3WUGCGs You need to know the data going into your AI for BOTH training and input. This was flawed automated input & could have easily been expected. -
Big IoT Data Analytics Through Fog Computing Technology
By
–
Big #IoT #DataAnalytics via Fog Computing http://
bit.ly/35ubEvj #Analytics #MachineLearning #AI #Python #Rstats #5G #FutureOfWork #flutter #java #IIoT #BigData #Cloud #Edge #SmartCity #CES2023 #FutureOfWork #100DaysOfCode #SDGs #Sustainability #DataScience #Automation -
Future Fund crisis threatens NeurIPS ML Safety workshop grants
By
–
"…there are many committed grants that the Future Fund will be unable to honor." The #NeurIPS2022 ML Safety Workshop (
https://
neurips2022.mlsafety.org) had an eye-watering $100k of awards for best papers and AI risk analyses. Given all the turmoil, I presume these are getting the axe? -
DARPA Research on Cryptocurrency National Security Risks
By
–
DARPA Research on Cryptocurrency and National Security Risks https://
oodaloop.com/archive/2022/1
1/08/darpa-research-on-cryptocurrency-and-national-security-risks/
… via @ooda -
Understanding Opportunity Cost: Swedish Economists’ Key Insight
By
–
A survey of every Swedish economist found the economics concept that would benefit the most people to understand is "opportunity cost." It is what you give up when you make a choice. Not just what you don’t buy, but also what you could have done by saving for later. Relevant!
-
China’s AI Workforce: Global Demand for AI Talent Event
By
–
A Virtual CSET Event: China’s AI Workforce – Demand for AI Talent in a Global Marketplace (Thursday, November 10th at 4 pm EST) https://
oodaloop.com/archive/2022/1
1/09/a-virtual-cset-event-chinas-ai-workforce-demand-for-ai-talent-in-a-global-marketplace-thursday-november-10th-at-4-pm-est/
… via @ooda -
ML Insights on Overfitting Apply Beyond Machine Learning Systems
By
–
Excellent post about applying insights from ML (overfitting control) to a much broader class of systems that optimize against an objective: politics, science, orgs, daily life. Underfitting is underrated.
-
AI Dominates TIME’s Best Inventions List for 2022
By
–
0% surprised that @OpenAI Dall-E 2 and @NVIDIA Instant NeRF made it onto the Best Inventions of 2022 list from @TIME
. Artificial intelligence has been its own category on the list since 2020. Expect it to grow.