Know the name of your strategic errors.
RESEARCH
-
Parallel Experiments Challenge in Multilingual Machine Learning Project
By
–
I also think there was a will to experiments on too many aspects at the same time and in parallel in BS: try a new organisation, a multilingual model with low-ressources languages, a new way of building a dataset (crowd sourcing of sources), attempts to train in fp16, etc etc
-
Large AI Teams: BigScience Lessons on Project Organization
By
–
yes, agree on the exhaustion feeling. BigScience was an experiment in trying to involve as many/diverse people as possible but a take-away is that too large teams can be counter-productive. Smaller projects like T0/ethics/RAIL were more successful inside BS than larger Bloom imo
-
K-Shot Learning for Non-RLHF Tuned LLMs
By
–
I’ve never seen it work on anything other than RLHF-tuned GPT-3. I’ve wondered if you could k-shot a non-RLHF model with meta-examples of instruction templates followed by input/output pairs for each, but haven’t tried it.
-
Murray Davis’s 12 Criteria for Theory Interestingness and Innovation
By
–
The 12 things that make a theory interesting, as classically listed by Murray Davis in a 1971 article, also can serve other purposes: like deciding what is a good topic for a popular article, or as a guide for finding disruptive ideas for the future. …
https://proseminarcro
ssnationalstudies.files.wordpress.com/2009/11/thatsi
nteresting_1971.pdf
… -
Enterprise AI Adoption Report 2022 Free Download
By
–
AI Adoption in the Enterprise 2022 Download Free Report from @OReillyMedia
: https://
get.oreilly.com/ind_ai-adoptio
n-in-the-enterprise-2022.html
… #AI #DeepLearning #DataScience #BigData #Analytics #Robots #100DaysofCode #IoT #serverless #DEVCommunity #womenwhocode #DigitalTransformation #Python #Robotics #MachineLearning -
100+ Free Data Science and Machine Learning eBooks
By
–
Free eBooks: 100+ Free Data Science Books http://
bit.ly/3AAD4At #NeuralNetworks #MachineLearning #TensorFlow #100DaysOfCode #BigData #Analytics #DevCommunity #Programming #IoT #javascript #Linux #Cloud #Serverless #womenwhocode #Python #RStats #DeepLearning #AI #DataScience -
TCP/IP Protocol Birth: Cerf and Kahn’s 1974 Breakthrough
By
–
#otd in 1974 TCP/IP was born, when Vint Cerf & Bob Kahn submitted a paper describing a protocol for sending packets across networks: https://
bit.ly/2QbDPpi -
AI Today Podcast explores lack of common AI definition
By
–
In this @Cognilytica #AIToday AI Glossary Series #podcast 'Artificial Intelligence' hosts @rschmelzer & @kath0134 share how there still is no commonly accepted definition for #artificialintelligence & Cognilytica’s definition for #AI. Full episode: https://
cognilytica.com/2022/11/04/ai-
today-podcast-ai-glossary-series-artificial-intelligence/?utm_source=dlvr.it&utm_medium=twitter
…
