LLMS

→ View original post on X — @miketamir

AudioCraft: Unified Audio Modeling Solution for AI

By

@miketamir

–

21 August 2023 21h01

AudioCraft: A simple one-stop shop for audio modeling https://
bit.ly/3Kt8Bby #AI #MachineLearning #DeepLearning #LLMs #DataScience

Multimodal LLMs Evaluation Without Image Datasets

By

–

21 August 2023 19h31

I don’t think there’s a restriction wrt to multimodal LLMs though (eg using techniques like LLaMA-Adapter v2). But yeah, the evaluation datasets won’t include images.

Positional Encoding and Attention Mechanisms in Neural Networks

By

–

21 August 2023 18h12

Hm good point and not sure. The positional encoding might not be required (there was a paper on that recently referred to as NoPE). Attention mechanisms I’d say are a generalization of MLPs (they could learn uniform weights if that’s useful). So I’d tend to say no.

Transformer publication timeline close to Bahdanau attention

By

–

21 August 2023 18h06

Ah no! Interesting, I didn’t know it was published only 1 month after Bahdanau attention for RNNs

→ View original post on X — @hwchase17

What retrieval areas deserve more research focus?

By

@hwchase17

–

21 August 2023 17h35

What areas of retrieval are most interesting to folks and we should push more on?

Self-Attention Mechanisms in Transformers: From RNNs to LLMs

By

–

21 August 2023 16h44

What motivated self-attention mechanisms in transformer-based LLMs in the first place?

A made a short video covering
– the limitations of RNNs
– the original (Bahdanau) attention mechanism for RNNs,
– how it all led to the original Transformer architecture used in LLMs https://t.co/oMLNlJMef6
— Sebastian Raschka (@rasbt) 21 août 2023

What motivated self-attention mechanisms in transformer-based LLMs in the first place? A made a short video covering
– the limitations of RNNs
– the original (Bahdanau) attention mechanism for RNNs, – how it all led to the original Transformer architecture used in LLMs

→ View original post on X — @johnchavens

LLM Water Consumption Crisis Overshadowed by AGI Hype

By

@johnchavens

–

21 August 2023 16h27

New storm in Southern California and an earthquake. But NO WORRIES – please keep the world’s narrative focused on when AGI will arrive and how LLMs are SO important that their literally life draining usage are more important than having WATER for planet and people.