We don't appreciate enough that ChatGPT & GPT-4, using just a few hundred GB of parameters, can distill immense human knowledge, and display exceptional reasoning & generalization skills. And you? How many GB of parameters are in your brain?
ChatGPT and GPT-4: Parameter Efficiency in Knowledge Distillation
By
–
Leave a Reply