A younger pediatrician and a famend doctor, who would deal with a child’s caught higher?
Though each are medical doctors and may deal with a toddler’s cough, a pediatrician is a specialist who can higher diagnose a child, isn’t it?
That is what fine-tuning does to smaller fashions. They make the tiny, weaker fashions clear up particular issues higher than the giants, which declare to do every part beneath the solar.
I used to be lately in a scenario the place I needed to decide one over the opposite.
I used to be constructing a query-routing bot. It routes the consumer question to the proper division, the place a human agent would proceed the dialog. Below the hood, it’s a easy textual content classification process.
GPT-4o (and the mini one) does it extremely nicely, nevertheless it’s inflexible and costly. It’s a closed mannequin, so you may’t fine-tune it in your infrastructure. OpenAI presents fine-tuning on its platform itself, however that’s too expensive for me.
Coaching GPT-4o prices $25/1M token. My coaching information was rapidly a couple of million tokens. Plus, serving the fine-tuned fashions prices about 50% extra than the common ones.