INNOVATION

→ View original post on X — @wadhwaniai

USAID India Showcases AI-Powered Healthcare Solutions

By

@wadhwaniai

–

16 November 2022 7h12

The @USAID / India Health Office organised their National Partners’ Meet in New Delhi on 15 November. At the meet, we showcased the impact of our work and demonstrated a number of our AI-powered healthcare solutions. @MoHFW_INDIA

→ View original post on X — @swyx

Useful Obsidian Templates for Daily Weekly Monthly Quarterly Annual

By

@swyx

–

16 November 2022 7h09

some very useful Obsidian templates here, daily/weekly/monthly/quarterly/annual!

Iterative Denoising: Simple Code, Core Idea

By

–

16 November 2022 6h49

like! tiny idea tiny code, strips away the formalism except the high level idea (iterative denoising on a schedule)

→ View original post on X — @swyx

How Technologies Become Standard: Adoption Process Framework

By

@swyx

–

16 November 2022 5h22

first they do it as part of their job then they do it as a stepping stone then it wins

→ View original post on X — @swyx

Replit Training Data Access Terms Review

By

@swyx

–

16 November 2022 4h44

i had a look at the terms. looks fine but replit doesnt have access for training data?

GPT Training Framework with Dataset and Sampling Tools

By

–

16 November 2022 4h21

Prompt: "You are a GPT and you're in charge of training an even better GPT, congrats! You have a dataset here . You can train it on document chunks like this: and sample its current understanding like this: . And here's a calculator and a scratchpad . Begin:"

→ View original post on X — @mrogati

Growing Up in the Virtual Fifties: Nostalgia and Tech Evolution

By

@mrogati

–

16 November 2022 4h07

I like to say that we grew up in the (virtual) 50s.

Meta-learning policies for LLM attention management during training

By

–

16 November 2022 4h05

Feels like a lot of fertile ground is left in managing the "attention" of an LLM during its training via a meta-learning policy, instead of the typical "memorize dataset uniformly at random" strategy. And giving it a calculator and a scratch pad.

Examples vs. Presentations: Spaced Repetition in LLM Training

By

–

16 November 2022 4h05

Is it the number of examples that matters or the number of presentations to the model during training? E.g. humans used spaced repetition to memorize facts but there are no equivalents of similar techniques in LLMs where the typical training regime is uniform random.