Just let LLMs be LLMs I notice the same sort of thing in image generation models too. Usually the base model, while less aesthetically pleasing, produce more interesting and creative images. And over time, this ‘artificial aesthetic’ loses its charm as outputs become boring.
Base Models Produce More Creative Outputs Than Fine-Tuned Versions
By
–
Leave a Reply