AI Dynamics

Global AI News Aggregator

About

Examples vs. Presentations: Spaced Repetition in LLM Training

Is it the number of examples that matters or the number of presentations to the model during training? E.g. humans used spaced repetition to memorize facts but there are no equivalents of similar techniques in LLMs where the typical training regime is uniform random.

→ View original post on X — @karpathy