H
19

Had to choose between a custom GPT and a fine-tuned model for a client's customer service bot.

Went with the custom GPT for its faster setup, but after three weeks of it giving overly vague answers to specific product questions, I'm wondering if the fine-tuned route on their own data would have been worth the extra two weeks of dev time.
2 comments

Log in to join the discussion

Log In
2 Comments
troyjackson
Classic case of saving time up front just to spend it later fixing vague answers. Been there more times than I'd like to admit.
8
olivia_chen35
Exactly what kind of vague answers is it giving? Like @troyjackson said, you saved time up front but now you're stuck fixing it. If it can't handle specific product details, that's a real problem. A fine-tuned model trained on their own manuals and support tickets probably would have nailed those questions. Two extra weeks of setup sounds better than endless tweaking now.
2