AI Dynamics

Global AI News Aggregator

About

Common Pile v0.1: 8TB Open Licensed Text Dataset for LLM Training

8. Common Pile v0.1 The Common Pile v0.1 is an 8TB dataset of openly licensed text designed for LLM pretraining, addressing legal and ethical concerns of unlicensed data use.

→ View original post on X — @dair_ai