Yes, it's more impressive. But if you are a small company that specializes on a specific task and has some custom data, I'd say that finetuning a smaller (e.g. 1.5 B) model is the way to go.
Fine-tuning smaller models for specialized tasks with custom data
By
–