There seems to be some growing hints that a few epochs of training on a high quality (and well deduplicated corpus) is just fine
AI
-
AI Intelligence Growth and Existential Risk Concerns
By
–
It's not smarter than us yet. I expect it to get smarter later, the same as it's been getting smarter over the past, and then to kill everyone. Do you remember how you acquired the belief "Eliezer thinks LLMs are smarter now"? I want to understand how to prevent this.
-
GANs, Discriminators, and Learning Human Error Patterns
By
–
The D in a GAN will, in principle and if ground hard enough, try to learn exactly which errors humans make, and knowing this would make D smarter than a human. That said, I still think there's an important in-practice sense where GANs have more imitation-nature than predictors.
-
Commercial 5G Launch Transforms Mobile Innovation and Digital Economy
By
–
Great topics! The commercial launch of #5G is a game changer. A whole new level of mobile #innovation #5G #MobileTechnology #DigitalEconomy #AI #IoT #Telecom #CSPs #DigitalTransformation
-
Impressive AI Clone Demonstrates Power of Team Collaboration
By
–
So wild how good this clone is! But yeah the team is what makes it even more impressive
-
PCA’s Relevance to AI Alignment Work Questioned
By
–
*Sigh.* I knew that meant "principal components analysis" without looking it up. I also knew about the controversy with ICA being patented. Now, what specific implication do you think PCA has for alignment work, exactly?
-
ASICs for LLM Inference: Specialized Hardware Solutions
By
–
Who is working on ASICs for inference on pre-trained LLMs? LLMs with frozen weights seem like ideal candidate for specialized hardware that can accelerate the inference process, reduce energy consumption, and potentially lower costs, making them an attractive option for
-
Stability AI Faces Serious International Legal Defense Challenges
By
–
Your inability to assess how serious the claims are means a lot though! (Plus they have basically confessed.). Stability doesn't have much of a defense that could hold internationally.
-
AI as Rebranded Computer Vision: Terminology Critique
By
–
AI is just a sexy term for compviz here imo