Here's info on the estimated emissions for pre-training for the Gemma 2 family of models (from a paper published in July 2024). Those models are open-sourced, so should be easy for external parties to measure inference costs under various compute environments/settings (as
DATA
-
SAP DataRobot secure AI forecasting for retail
By
–
SAP and DataRobot streamline the delivery of secure AI, empowering businesses to quickly embed AI into any SAP application. Join us for an episode of @SAP DATARetail on how together we help retail organizations deliver accurate, safe forecasts. Date: October 21 Time: 9:00
-
Gemma 2 Model Series: Emissions Estimates for AI Training
By
–
In July 2024, we released emissions estimates for pre-training the Gemma 2 model series (2B, 9B, and 27B parameter models, so ~12X, ~43X, and ~128X larger than the 213M parameter models you were looking at, and respectively trained on 2T, 8T, and 13T tokens of data). We estimate
-
Bias Variance Not Same as Approximation Estimation
By
–
Bias/Variance is not the same as Approximation/Estimation https://
bit.ly/3Y5kDit
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
LLM360 releases TxT360: 15T token pre-training dataset
By
–
TxT360: new pre-training dataset with 15T tokens Impressive release from LLM360 with a new pre-training dataset of 15T tokens. It includes a lot of new sources compared to previous open-sourced pre-training datasets, like FreeLaw, PG-19 (books), etc. It's really interesting
-
AI Enters the Critical Mineral Race
By
–
AI Enters the Critical Mineral Race
#AI #AIio #BigData #ML #NLU #Futureofwork @TunstallAsc @StrategyFintech @TamaraMcCleary @TerenceLeungSF @psb_dc @thomaspower @vinod1975 @ylecun -
Netflix Introduces Key-Value Data Abstraction Layer
By
–
Introducing Netflix’s Key-Value Data Abstraction Layer https://
bit.ly/3TVsgph
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Intel Xeon 6 and DSA Accelerate Data Center AI Workloads
By
–
🚀 Accelerate your business with Intel® Xeon® 6 and Intel® DSA!
— Pascal Bornet (@pascal_bornet) 8 octobre 2024
Optimize your data center, boost productivity, and drive innovation with high-speed data movement.
Analyze info in real-time, make smarter decisions, and power AI & cloud workloads without performance compromises.… pic.twitter.com/VniDIUUeDlAccelerate your business with Intel® Xeon® 6 and Intel® DSA! Optimize your data center, boost productivity, and drive innovation with high-speed data movement. Analyze info in real-time, make smarter decisions, and power AI & cloud workloads without performance compromises.
-
Evidently AI: 450 Machine Learning and LLM System Design Case Studies
By
–
Evidently AI – ML and LLM system design: 450 case studies https://
bit.ly/3Y7A1Lw
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Scientific Data Integrity in AI Research Papers
By
–
Please see, for example, a paper I worked on to provide more data: https://
arxiv.org/pdf/2104.10350 (and in particular Appendices C and D). (And all the information needed to get things correct as shown in Appendix C was public already). I find the continued use of data now known to be