I don't know about tinygrad. But Keras with JAX is typically 30% faster than PyTorch, sometimes more. Our SegmentAnything implementation is 5x faster than the original PyTorch version.
CODE
-
Recommendation to Switch to Python for Keras Development
By
–
I definitely recommend switching to Python. Everything Keras related is being developed for Python first.
-
Universal API for ML Components Across All Frameworks
By
–
You can use this API to write layers, metrics, optimizers, etc. that work the same in any framework. One codebase, compatible with the entire ML ecosystem.
-
NumPy optimization framework supporting multiple deep learning backends
By
–
You can think of it as an optimized & extended NumPy that compiles to any of JAX, TF, PyTorch, or… NumPy itself.
-
Keras 3 Introduces Low-Level API Supporting JAX TensorFlow PyTorch
By
–
Keras 3 features a low-level `keras.ops` API with 201 functions that work in JAX, TensorFlow, and PyTorch with the exact same semantics and numerics. This includes 137 NumPy ops. It's not "numpy-like", it's literally the NumPy API (plus a bunch of NN ops).
-
Hugging Face Deep Reinforcement Learning Course Launch
By
–
Welcome to the Deep Reinforcement Learning Course – Hugging Face Deep RL Course https://
bit.ly/3PMaByU #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Which retrieval method and vectorstore should you choose?
By
–
Which retrieval method/vectorstore do you want
-
Pair Programming as High-Leverage Teaching and Skill Transfer
By
–
pair programming is very high leverage — you don’t just get the immediate task done, but also teach someone to be able to do it themselves
-
GPT as Turing Machine: Programming Capabilities Explained
By
–
GPT is becoming a Turing machine: Here are some ways to program it Ana Jojic, Zhen Wang, Nebojsa Jojic: https://
arxiv.org/abs/2303.14310 #GPT #ChatGPT #TuringMachine -
Self-Attention Mechanism in Large Language Models Explained
By
–
Understanding and Coding the Self-Attention Mechanism of Large Language Models From Scratch https://
bit.ly/3YL821l #AI #DeepLearning #MachineLearning #DataScience