Yeah I think it's a signal that their custom crawler code is full pretty unsophisticated – I would guess it took search engines like Google and Bing years of iteration to get their crawlers to avoid all of the possible dumb mistakes like that
CODE
-
Smart data crawling strategy local iteration analysis
By
–
A dumb crawler doesn't necessarily mean that they're not doing something smarter with the content once it's been crawled – it's generally a good idea to crawl once and then iterate on analysis against your local copy
-
TMLR Paper with Experiments, Data and Code Resources
By
–
More experiments can be found in our TMLR paper: https://
arxiv.org/abs/2310.14540
Data and code: https://
huggingface.co/datasets/yyama
da/SpatialEvalLLM
…, https://
github.com/runopti/Spatia
lEvalLLM
…
Special thanks to @AndrewLampinen for helpful discussion and advice!
7/n -
Open Source Library Seeking Evaluation Support
By
–
I do actually have an open source library that needs evals right now – and it's open source (or will be) so no need to hide anything – I'll message you
-
DSPy: Automatic Prompt Optimization Through Example Derivation
By
–
My current mental model of DSPy is that it leans into the thing where LLMs can produce much better output if you prime them with the right examples – then helps automatically derive the best examples based on running some evals I may have misunderstood it though
-
Building Custom Datasets for DSPy: Overcoming Documentation Gaps
By
–
The getting started documentation currently uses an existing dataset – dspy.datasets.gsm8k – but that skips the most intimidating part of the closes which is figuring out how to build a dataset for my own problem https://
dspy-docs.vercel.app/docs/quick-sta
rt/minimal-example
… -
Building Evaluation Sets: Detailed Tutorials and Worked Examples
By
–
The more tutorials with extremely detailed worked-through examples of building an evaluation set the better I think
-
DSPy Documentation Challenges for Deep Learning Practitioners
By
–
Yeah, I've done a little bit of deep learning in the past (took a Fast AI course a few years ago) and I still find that the DSPy documentation that compares how to use it to deep learning doesn't help me that much
-
Using DSPy Without Building Evaluations: A Learning Curve Challenge
By
–
Can you use DSPy without building evals? Because building evals is an enormous learning curve for most people (myself included)
-
Data AI Summit Early Bird Registration Discount Ends April 30
By
–
Early bird catches the worm Save $400 by registering for #DataAISummit before April 30! You’ll explore the latest advances in #ApacheSpark, Delta Lake, MLflow, LangChain, PyTorch, dbt, and more: https://
bit.ly/3UlaDA7