Another amazing landmark achiement to promote the key objectives of digital economy @Dalyahya
TECHNOLOGY
-

In-Context Learning Performance with Extreme Long-Context Models
By
–
10). In-Context Learning with Long-Context Models – studies the behavior in-context learning of LLMs at extreme context lengths with long-context models; shows that performance increases as hundreds or thousands of demonstrations are used.
-
Neural Network Training Scaled 30X Beyond Previous Literature Records
By
–
This system successfully scaled up training of a neural net 30X larger than previously reported in the literature. You're somehow not very knowledgeable & very opinionated about it, referring to it as a "dead end". Even your "Apologies for the confusion" tweet is incorrect.
-

Backpropagation Support in Neural Networks ICML Paper
By
–
It supported backprop from day one, so I'm not sure where you got that Idea. From the ICML paper you mention above:
-

Building RAG Web App with Streamlit and Embedchain
By
–
1. Import necessary libraries • Streamlit for building the web app
• Embedchain for the RAG functionality -
CPU GPU TPU support evolution in machine learning framework
By
–
(Initial version supported CPUs. Later versions added support for GPUs and TPUs).
-
Deep Learning Evolution From Academic Niche To Commercial Dominance
By
–
For me at least it’s partly that the need isn’t as great now as in 2013 when we planned v1. Deep Learning has gone from a niche academic workshop topic to the most publicized product of more than one > trillion dollar company.
-

Anthropic copies ChatGPT’s interface for Claude
By
–
The most interesting part is – Anthropic is working on a new UI for Claude AI that looks like… ChatGPT!
-
Evolution of Programming Languages in Machine Learning Research Career
By
–
In roughly all of my experience (Geoff/Ruslan RBM work at UofT, Nando lab at UBC, Andrew Ng lab at Stanford, my 2011 Google internship in baby Google Brain, and ~all computer vision work I was familiar with) it was all only Matlab. I’ve never used Theano but I used Torch in
-
Gap between most capable AI and second most capable will increase
By
–
Consider this: The gap between the “most capable” AI and the “second most capable” will actually increase with time.