Yeah, I think if two identical texts are concatenated, the size of the compressed concatenated file should match the size of the unconcatenated files right?
@rasbt
-
Gzip and kNN Outperform Transformers for Text Classification
By
–
Gzip + kNN beats transformers on text classification. (Gzip as in good old zip file compression)
-
Sarcastic critique of AI alignment solution timeline claims
By
–
Congrats! You should join forces with the other company who just announced that they will solve AI alignment in <4 years. So you can both work on “solving the universe” once your are done with these more near-term projects.
-
Self-Supervised Learning for LLM Pretraining and Evaluation Methods
By
–
We use self-supervised learning to pretrain LLMs (e.g., next-word prediction). Here's an interesting take using self-supervised learning for evaluating LLMs: https://
arxiv.org/abs//2306.13651
Turns out, there's correlation between self-supervised evaluations & human evaluations. -
Miniforge: The Go-To Package Manager for M1 Mac Python
By
–
Yes, same! When I upgraded to an M1 mac a few years back, miniforge was the only one supporting Python for Apple Silicon , and I've been using it ever since!
-
LLMs as Coding Companions: Automating Low-Level Tasks with Human Guidance
By
–
Yeah, I think LLMs will automate most of the low-level programming tasks. They will get you +90% of the way there. But I still see it more as a coding companion that needs human interaction and guidance.
-
R, Python, Julia: The Current State of Statistical Computing
By
–
It's once again back to how it started: being a useful toolkit for statistics (a lot of the more hardcode stats and research stuff is only available in R). But yeah, not really used anymore for computing: here machine learning people use Python and statisticians use Julia.
-
Elements of Statistical Learning: A Highly Referenced Classic Book
By
–
Elements of Statistical Learning is a classic. I even have two hard copies (one for my office and one at home) because I referenced it so often.
-
Next Generation LLMs Self-Development Without Human Researchers
By
–
And the next gen of LLMs will develop itself? No coders and researchers required?
