Yup, totally agree. That’s probably it. Afaik the reason why they couldn’t open-source the LLaMa weights was the dataset. So instead of scraping data from elsewhere and staying on shaky legal grounds, getting data from your own platform is probably easiest.

→ View original post on X — @rasbt,