My guess is that copyright law is fundamentally incompatible with LLMs but it’s not going to go down easily.
LLMS
-
Training Data Leakage in AI Models and Future Obfuscation
By
–
That is the big question. At least the current models leak training data. However, they’ll likely get better at obfuscation over time.
-
Scaling Strategy Over Fine-Tuning for Emergence
By
–
Probably should also leave them a note to tell them to scale up for emergence and not wasting a couple of years on fine-tuning 100m encoder models.
-
LLM Model Release: Caution on Bleeding Edge AI Research
By
–
I still am fwiw, I'm just not sure that this should apply to *bleeding edge* LLM models – they still feel new, are an active area of research, have non-trivial 2nd and 3rd order effects. I think it makes sense for some/smaller models, with some lag (e.g. GPT-2 release).
-
LLM Bias: Recognition, Challenges, and Iterative Improvement Process
By
–
the bias is widely recognized as a concerning issue and being worked on. this is not a trivial process – LLM behavior is emergent from large training datasets; tuning it involves setting up evaluations, then running experiments to improve them over time.
-
FLAN2 Paper on Language Model Fine-tuning Released
By
–
Oh I mean the flan2 paper. https://
arxiv.org/abs/2210.11416 -
SambaNova achieves GPT-175B performance with 10x efficient model
By
–
TECHNICAL BLOG: Learn how one can use the SambaNova platform to develop a GPT 13B parameter model that can outperform a GPT 175B parameter model. https://
sambanova.ai/blog/https-ach
ieving-gpt-175b-level-accuracy-with-a-10x-more-efficient-model/
… -
Flan and UL2 Missing from Citations List
By
–
Hmm. Where is Flan and UL2 on the list? They have more than 40 citations for sure. And probably more. IIRC flan2 has much more than that.
-
Daily Python, Machine Learning and Language Models Content Sharing
By
–
That's a wrap. Every day, I share and simplify complex concepts around Python, Machine Learning & Language Models. Follow me → @Sumanth_077 if you haven't already to ensure you don't miss that. Like/RT the first tweet to support my work and help this reach more people.