Can a custom classifier catch a policy specific to my agent?
Yes, that’s what a custom classifier is for. The built-ins cover failure modes every agent shares: frustration, malformed output, secret leaks. A custom classifier covers the ones only yours has, the policy it has to follow, a mistake it actually makes, a behavior your team already knows to watch for and has never had a check on.
Examples of the kind of thing this catches: a support agent that isn’t allowed to promise a specific refund amount, a coding agent that shouldn’t touch a particular file path, a booking agent that has to confirm a date before finalizing it. None of those are failure modes a generic classifier would know to look for, because they aren’t generic, they’re yours. A custom classifier is trained on your own traffic specifically so it can catch them.