we're starting to see top companies spend the same amount on RLHF and compute in training ChatGPT-like LLMs for example, OpenAI hired >1000 devs to RLHF their code models crazy—but soon companies will start spending $ hundreds of Ms or $ billions on RLHF, just as w/compute
Companies Spending Billions on RLHF Training for LLMs
By
–