Detect (Near) Duplicates Near duplicated examples may record the same information with different: Check this out 5/n
@akshay_pachaar
-
Datalab Detects Label Errors with Confident Learning
By
–
Detect Label Issues With one line of code, Datalab detects label errors (via Confident Learning) as well as many other important issues. Check this out 4/n
-
Datalab Automatically Detects Data Quality Issues
By
–
For each type of issue, Datalab automatically estimates: – Which examples in the dataset suffer from this issue
– How severe this issue is (via a quality score)
– And how severe overall the issue is across the dataset. Detect Outliers 3/n -
Datalab: Magic Wand for ML Dataset Inspection
By
–
How to use Datalab Datalab works with any ML model you have already trained! It's like a magic wand! Inspecting your dataset with Datalab merely requires the code below! 2/n
-
Python ML/MLOps and AI Engineering Tutorials Daily
By
–
If you interested in: – Python – ML/MLOps – CV/NLP – LLMs – AI Engineering Find me → @akshay_pachaar Everyday, I share tutorials on above topics! Cheers!
-
Python Library Extracts PDF Tables to Pandas DataFrames
By
–
This Python library is so powerful A few lines of code & you can extract Tables from PDF & load it as a Pandas df! Check this out
-
CleanLab tutorials for data cleaning and machine learning
By
–
Not sure about R, but there are some really good tutorials on CleanLab
-
Python ML NLP LLMs AI Engineering Tutorials Daily
By
–
If you interested in: – Python – ML/MLOps – CV/NLP – LLMs – AI Engineering Find me → @akshay_pachaar done
Everyday, I share tutorials on above topics! Cheers! -
AI Tool Automatically Detects Spelling Errors Inaccuracies Prompts
By
–
It enables you to automatically detect: – Spelling errors
– Factual inaccuracies
– Incomplete/vague prompts
– Context-based inaccuracies
– And more … Read the full article here: -
Automated Techniques Identify Low-Quality Data in Instruction Tuning
By
–
I recently read a great article that showcases automated techniques to identify and weed out low-quality data in any instruction tuning dataset. They even put the famous Dolly-15k dataset under the microscope, and the findings are eye-opening! continue reading ….