Context: People are misunderstanding the GPT-3 – 11 minutes training result from the latest MLPerf.
reference:
RESEARCH
-
MLPerf GPT-3 Training Results Clarification Explained
By
–
-
GPT-3 Training Speed: Clarifying the 11-Minute Claim
By
–
No, GPT-3 wasn't trained in 11 minutes. The GPT-3 architecture was trained on the C4 dataset to 2.69 log-probability in 11 minutes on 3584 H100 GPUs. Don't focus on the "11 minutes" — because it's like saying "ResNet-50 was trained in 5 seconds on MNIST to 80% accuracy"
-
Pruning Large Language Models Without Retraining Using Activation Norms
By
–
LLMs are usually too large for most contexts, but creating pruned versions of a model usually require retraining. Here's a new straightforward alternative based on computing element-wise product between the weight magnitude and norm of input activations: https://
arxiv.org/abs/2306.11695 -
Quantum Computing Threats to Ethereum: Mitigation Strategies
By
–
Wondering what you think about the potential threats to the future Ethereum ecosystem will be when the quantum age is upon us and what actions we should be taking now to mitigate those threats?
-
Extinction Risk vs Catastrophic Risk in AI Safety
By
–
Extinction risk is not the same as catastrophic risk; this is a good paper, primarily on the latter.
-
Distinguishing Catastrophic Risk from Extinction Risk in AI
By
–
This is a good paper, and rightly distinguishes catastrophic risk from extinction risk.
-
Digital Fraud Trends in Evolving Global Economy
By
–
As the digital landscape continues to evolve, so does the 'Global Scam Economy'. A recent study by Javelin Strategy & Research and SAS highlights the emerging fraud trends in our increasingly digital world . The COVID-19 pandemic catalysed a revolut…
https://
lnkd.in/eu4p6e_x -
Researcher shares cool AI paper on Hugging Face platform
By
–
hi @kchonyc
, do you by any chance have a HF profile? i wanted to link this very cool paper (and a few others as well!): https://
huggingface.co/papers/2306.13
588
… cc @Thom_Wolf -
Machine Learning and Data Science Communities in India
By
–
@jeevprabnivash @Reddit @StackOverflow #INDIAai #MachineLearning #DataScience #ai
-
AI Research: Multi-Modal Summarization and Behavior Analysis
By
–
Dive into the fascinating world of AI research! Discover the power of multi-modal summarization, social media engagement prediction & player behavior analysis in card games. Tap the link and read this segment of INDIAai's 'Research Roundup': https://
rb.gy/om1o6