alright y'all. still having GPU utilization issues and against my better judgement i broke out the PyTorch profiler. posting a few screenshots. doesn't seem like I/O is an issue (no gaps) how is GPU util so bad (~30%) if either forward or backward is running almost always?
CODE
-
Inside BERT: Forward Pass Architecture and Operations
By
–
here's a zoomed in forward pass. it's classic BERT stuff. linear layers, matmuls, softmaxes, some other stuff
-
Fine-tune SDXL Image Generator with Just 5 Images
By
–
We made it super easy to train your own image generator! You can finetune SDXL on any subject, scene, or style you want, with as few as 5 images. Run it on an API with Replicate as soon as it's finished training. Literally couldn't be easier
-
Restricted API Keys Now Live for Enhanced Security
By
–
Restricted API keys are now live: https://t.co/RLT9IQ9Quh
— Greg Brockman (@gdb) 7 février 2024Restricted API keys are now live:
-
Self-Reflective RAG Enhancement Using LangGraph
By
–
Self-Reflective RAG using LangGraph Self-reflection can enhance RAG, enabling correction of poor quality retrieval or generations. Several recent papers focus on this theme, but implementing the ideas can be tricky. Here is a video and two cookbooks that show how to engineer
-
Optimizing Transformer Training on Single GPU with HuggingFace
By
–
what are some easy ways for a normal person like me to speed up training a transformer on a single GPU? i'm using huggingface T5 implementation + defaults. i know about FlashAttention and BetterTransformer and torch compile? will these all work together? is there anything else?
-
Modin Project Repository Checkout
By
–
Checkout the Project Repository here: https://
github.com/modin-project/
modin
… -
Modin: A Python Library 10x Faster Than Pandas
By
–
Pandas is one of the most important libraries for Data Science.
— Sumanth (@Sumanth_077) 7 février 2024
But when working with larger datasets it becomes really slow and runs out of memory
Introducing Modin a python library which is 10x faster than Pandas🔥
Thread🧵👇 pic.twitter.com/Wl09g5OmdKPandas is one of the most important libraries for Data Science. But when working with larger datasets it becomes really slow and runs out of memory Introducing Modin a python library which is 10x faster than Pandas Thread
-
Modin: Accelerating Pandas on Large Datasets
By
–
Modin works well on larger datasets, where pandas becomes slow or runs out of memory Check the below example, Pandas (left) and Modin (right) performing the same pandas operations on a 2GB dataset. The only difference between the two examples is the import statement: