Amazing! Can't wait to try it out! Do you think we should start adding the training parameters as practice on the model card, like number of iterations, etc.?
OPEN SOURCE
-
Major Tech Companies Join AI Alliance for Open Innovation
By
–
Excited to share that we've joined @IBM @Meta @Snowflake @Databricks and 50+ organizations to support the #AI Alliance: a community of leading organizations across industry, research and gov coming together to support #open innovation in AI. https://
pbase.ai/3UwJpXu -
Modular Library Advances Sparse Machine Learning Research
By
–
(9/n) Our library is modular and extensible, enabling users to define algorithms without complex rewrites. It is already pivotal in supporting in-house research on sparsity, demonstrated through our works: *Sparse-IFT: https://
openreview.net/pdf?id=iP4WcJ4
EX0
…, and https://
proceedings.mlr.press/v216/thangaras
a23a.html
… * -
RigL Dynamic Weight Sparsity Algorithm Implementation PyTorch
By
–
(8/n) These allow us to implement popular dynamic weight sparsity algorithms such as Rigging the Lottery (RigL) from @GoogleDeepMind
. Enabling these algorithms for any existing PyTorch model in our ModelZoo is as simple as making a few changes in our configuration file. -
PyTorch Sparse Optimizers for Efficient Model Training
By
–
(6/n) We rely on PyTorch’s optimizer interface to design all our sparse algorithms as special optimizers, which operate on a sparse view of the model parameters and gradients during training. We use a wrapper over existing PyTorch optimizers, which enables efficient
-
Library Enables Dense and Sparse AI Training Workloads
By
–
(4/n) Our library has been co-designed from the ground up to run both dense and #sparse training workloads. This enables practitioners to focus on what they do best: push the boundaries of AI research.
-
Cerebras Releases PyTorch Sparsity Library for ML Researchers
By
–
(1/n) Excited to announce the "Cerebras PyTorch Sparsity Library," which democratizes access to #sparse training for all #ML researchers and developers. Read more here: https://
cerebras.net/blog/sparsity-
made-easy-introducing-the-cerebras-pytorch-sparsity-library
… -
Build AI Agents with Open Source Mixtral Models
By
–
Build Agents with Open Source Models! Explore the latest in context-aware search with our new template by @tjaffri
, powered by @MistralAI 's open-source mixtral model & hosted on @FireworksAI_HQ . It searches academic papers on Arxiv out of the box, and customize it with -
Hugging Face Competitions: New Features and Enhanced Customization Options
By
–
New Features in Hugging Face Competitions – support for multiple metrics
– custom metrics
– fully hidden test set
– custom hardware support: CPU, A10g, A100
– custom requirements support
– custom time-limit for submission runs
– support for not just submission.csv but any