Tagged evals

I have 50k labeled support tickets to route into 12 categories. Prompting GPT 5 works but costs add up at volume. When does fine tuning a small model pay off?

Sharing a snippet that cut hallucinations noticeably in my eval set. Works across Claude and GPT. Curious if others have a tighter version.