RESEARCH - AI Dynamics

Hungry Hungry Hippos: Language Modeling with State Space Models

By

–

02 February 2023 2h02

(3/12) Hungry Hungry Hippos: Towards Language Modeling with State Space Models
Authors: @tri_dao
, @realDanFu
, Khaled K. Saab, @ai_with_brains, Atri Rudra, Christopher Ré @HazyResearch @SnorkelAI

→ View original post on X — @cohere

2 February 2023

OPT-IML: Scaling Language Model Instruction Meta Learning

By

@cohere

–

02 February 2023 2h02

(2/12) OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Authors: Srinivasan Iyer, @VictoriaLinML
, Ramakanth Pasunuru, @tbmihaylov
, @simigd
, Ping Yu, et al.

→ View original post on X — @cohere

2 February 2023

Top NLP Papers January 2023: Language Models and Text Generation

By

@cohere

–

02 February 2023 2h02

(1/12) Stay ahead of the curve with the top NLP papers of January 2023. From language models to text generation, this curated list by @forai_ml has got you covered on the latest advancements in language AI
This social post has been generated with Cohere https://
txt.cohere.ai/top-natural-la
nguage-processing-nlp-papers-of-january-2023
…

→ View original post on X — @cohere

2 February 2023

ICLR 2023 Accepted Papers Now Visible on OpenReview

By

@thegautamkamath

–

02 February 2023 1h44

Accepted (and not accepted) papers for @iclr_conf are now visible and de-anonymized on OpenReview #ICLR2023 https://
openreview.net/group?id=ICLR.
cc/2023/Conference
…

→ View original post on X — @thegautamkamath

2 February 2023

Scale AI RLHF Methods and Approaches

By

@alexandr_wang

–

02 February 2023 1h01

also, more on what @scale_AI does on RLHF:

→ View original post on X — @alexandr_wang

2 February 2023

AI bias learning freedom versus ethical concerns debate

By

@dotcsv

–

02 February 2023 1h00

Sólo espero que la gente que llora ahora no sea la misma que se ha venido quejando todos estos años cuando se hablaba de que la IA aprendía sesgos raciales, de género y tantos más de Internet. ¿No era que a la IA había que dejarla aprender en libertad?

→ View original post on X — @dotcsv

2 February 2023

Companies Spending Billions on RLHF Training for LLMs

By

@alexandr_wang

–

02 February 2023 0h57

we're starting to see top companies spend the same amount on RLHF and compute in training ChatGPT-like LLMs for example, OpenAI hired >1000 devs to RLHF their code models crazy—but soon companies will start spending $ hundreds of Ms or $ billions on RLHF, just as w/compute

→ View original post on X — @alexandr_wang

2 February 2023

Scale AI Discusses RLHF Strategy with OpenAI

By

@alexandr_wang

–

02 February 2023 0h57

btw if you want to chat about your RLHF strategy with us @scale_AI — reach out! DMs are open source on OpenAI:

→ View original post on X — @alexandr_wang

2 February 2023

AI Tools Disclosure Standards for Academic Authors

By

@thegautamkamath

–

02 February 2023 0h51

1. Authors should report tools they use (consistent with field standards)
2. Authors always take responsibility for paper contents
3. Generative AI should not be listed as an author Seems sensible enough.

→ View original post on X — @thegautamkamath

2 February 2023