my notes are here for those following along https://
github.com/sw-yx/ai-notes
/blob/main/TEXT.md#chatgpt
…
AI
-
AI Notes on ChatGPT and Related Technologies
By
–
-
Learn Data Science: Essential Resources and Tutorials
By
–
Try these: https://
x.com/DataChaz/statu
s/1536030599923830786
… https://
x.com/DataChaz/statu
s/1542223758433439746
… https://
x.com/DataChaz/statu
s/1193905658950823936
… https://
kaggle.com/learn -
Model with 8192 token context, double others, no RLHF tuning
By
–
It also has a context window of 8192 tokens, which is 2x any of the instruction-following models available in the API. Also the model is internally labelled “text-davinci-002-render”, which would seem to imply it doesn’t include RLHF tuning (unique to 003).
-
Fine-tuning process and 8192 token context window
By
–
It’s clearly a very different fine-tuning process, which they talk about in some detail in the announcement. Also the context window is 8192 tokens, double any of the text models available through the API.
-

AIOps: Real-time IT Issue Detection via Analytics and Machine Learning
By
–
#AIOps uses analytics and #machinelearning in order to analyze #bigdata from various #IT operation tools and devices. As a result, it is able to automatically spot and more importantly react to issues in real-time.
Via @ingliguori #MLOps #DigitalTransformation #DevOps #IoT #IIoT -

Large financial firms adoption of deep learning since 2016
By
–
Some large hedge funds, investment banks, and financial firms started getting into deep learning around 2016 (though probably not into Deep RL). That probably paid off well!
-
Deep RL for Real Robots: Limited Success in 2016
By
–
Deep RL for real robots didn’t really work so well back in 2016.
-
Deep RL at Peak Hype in 2016, AGI Hopes
By
–
Deep RL was at peak hype during NIPS2016. Everyone thought training a ConvNet to play a few Atari games using Q-Learning would lead to AGI.
-
Token window doubled to 8192, nothing fancy
By
–
I’m fairly confident they just doubled the window to 8192 tokens. It’s not doing anything fancy.