GENERATIVE AI

→ View original post on X — @alexandr_wang

CAPEX vs OPEX: AI Infrastructure and Data Spending Economics

By

@alexandr_wang

–

02 February 2023 2h15

maybe if you compare compute CAPEX vs data OPEX, but if you amortize CAPEX then for major players they are similar orders of magnitude data spend will stay high because while # of hrs goes down, specialization will increase $/hr (and model value) & prod models need validation

SparseGPT: One-Shot Pruning of Massive Language Models

By

–

02 February 2023 2h02

(8/12) SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
Authors: @elias_frantar
, @DAlistarh

Teaching Small Language Models to Reason

By

–

02 February 2023 2h02

(6/12) Teaching Small Language Models to Reason
Authors: Lucie Charlotte Magister, Jonathan Mallinson, Jakub Adamek, @ericmalmi
, Aliaksei Severyn

CiT: Data Curation Methods for Vision-Language Model Training

By

–

02 February 2023 2h02

(5/12) CiT: Curation in Training for Effective Vision-Language Data
Authors: Hu Xu, @sainingxie
, Po-Yao Huang, @Licheng_Yu
, Russell Howes, Gargi Ghosh, Luke Zettlemoyer, @cfeichtenhofer

A Watermark for Large Language Models

By

–

02 February 2023 2h02

(4/12) A Watermark for Large Language Models
Authors: @jwkirchenbauer
, @jonasgeiping
, Yuxin Wen, Jonathan Katz, Ian Miers, Tom Goldstein

Hungry Hungry Hippos: Language Modeling with State Space Models

By

–

02 February 2023 2h02

(3/12) Hungry Hungry Hippos: Towards Language Modeling with State Space Models
Authors: @tri_dao
, @realDanFu
, Khaled K. Saab, @ai_with_brains, Atri Rudra, Christopher Ré @HazyResearch @SnorkelAI

OPT-IML: Scaling Language Model Instruction Meta Learning

By

–

02 February 2023 2h02

(2/12) OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Authors: Srinivasan Iyer, @VictoriaLinML
, Ramakanth Pasunuru, @tbmihaylov
, @simigd
, Ping Yu, et al.

Top NLP Papers January 2023: Language Models and Text Generation

By

–

02 February 2023 2h02

(1/12) Stay ahead of the curve with the top NLP papers of January 2023. From language models to text generation, this curated list by @forai_ml has got you covered on the latest advancements in language AI
This social post has been generated with Cohere https://
txt.cohere.ai/top-natural-la
nguage-processing-nlp-papers-of-january-2023
…