Definitely a real issue with LLM development. The "data wall" + how challenging it is to generate new data is a major elephant in the room. That being said, not insurmountable:
– Hybrid data where human experts produce dramatically more data utilizing synthetic methods is going

→ View original post on X — @alexandr_wang