In the words of Tony Blair on how can governments lead in data governance: AI evolves and advances very fast so only by international partnerships we can all address the AI challenges. THIS IS THE @GPAI_PMIA mission and vision
AI
-
AI Helps Discover 80000 Dolby Atmos Music Tracks
By
–
I wish some AI would help me find more Dolby Atmos music. Found about 80,000 tracks so far for world’s largest collection:
-
Standard Practice for Pruning Linear Layers in Neural Networks
By
–
I haven't seen that yet. I think the standard is to prune all linear layers, this includes the QVK of the attention layers and the FC layers (except the embedding and output layers of course).
-
MLPerf GPT-3 Training Results Clarification Explained
By
–
Context: People are misunderstanding the GPT-3 – 11 minutes training result from the latest MLPerf.
reference: -
GPT-3 Training Speed: Clarifying the 11-Minute Claim
By
–
No, GPT-3 wasn't trained in 11 minutes. The GPT-3 architecture was trained on the C4 dataset to 2.69 log-probability in 11 minutes on 3584 H100 GPUs. Don't focus on the "11 minutes" — because it's like saying "ResNet-50 was trained in 5 seconds on MNIST to 80% accuracy"
-
Pruning Large Language Models Without Retraining Using Activation Norms
By
–
LLMs are usually too large for most contexts, but creating pruned versions of a model usually require retraining. Here's a new straightforward alternative based on computing element-wise product between the weight magnitude and norm of input activations: https://
arxiv.org/abs/2306.11695 -
Tech’s Parabola Returns to Earth: Market Trends Analysis
By
–
The TL Podcast for June 26th, 2023: Tech’s parabola returns to earth https://
thetechnologyletter.com/the-posts/the-
tl-podcast-for-june-26th-2023-techs-parabola-returns-to-earth
… Or catch it on Apple Podcasts: http://
bit.ly/40HBLJg $PTON $WE $COHR $AMD $HPE $ORCL $AI $EQIX $FSLY $IOT $MDB #investing #stocks #podcasts #technology #AI -
UK’s Role in Global AI Governance at Chatham House Discussion
By
–
At Chatham House discussing Global AI Governance: What is the UK’s role? With Brad Smith President @Microsoft PM Tony Blair and @Marthalanefox @GPAI_PMIA has a very strong leadership take on data governance supporting all national agendas for #datagovernance @JeniT
-
Intel’s Habana Gaudi2 Positions Company for Monster Quarter
By
–
Intel could have a ‘monster’ quarter Intel’s Habana Gaudi2 is suddenly a very interesting asset. https://
thetechnologyletter.com/the-posts/inte
l-could-have-a-monster-quarter
… $INTC $NVDA $AMD #investing #semiconductors #AirQuality -
IBM watsonx: Revolutionary AI Power for Global Partners
By
–
Unleashing the Power of AI with IBM watsonx: A Revolutionary Leap for IBM's Global Partner Network is my latest article in partnership with @IBM
, exploring the power of watsonx. Full article > https://
bit.ly/3JAgs6L Paid partnership with @IBM
. #IBMPartner #AI #watsonx