all answers

General agent concepts

System one models

A System One model is a model built to make a decision rather than write text. You give it input, such as a support ticket, a JSON object, or an agent's last tool result, plus the questions you want answered and the answers allowed. It returns one of those answers with a probability, in a single pass, in well under a second. The name borrows Kahneman's split between fast, intuitive System 1 thinking and slow, deliberate System 2 reasoning. TypeSafe AI coined it in September 2026 when it launched Jev, and open models now use the label too.

The point is the probability. A model whose "90% sure" answers are right about 90% of the time lets software set a threshold: act on its own above it, and hand the case to a person or a reasoning model below it. An LLM that states its own confidence can't be used that way, because the confidence it reports doesn't track how often it's right.

Most of what an agent does between reasoning steps is this kind of decision: which route, which tool, whether a request is a refund, whether an output is safe to send. A System One model takes those off the LLM. It does not explain its answers and it cannot generate, so anything that needs reasoning or writing still goes to an LLM.

9 questions

Answered, plainly.

Are there open-source System One models?Yes, but most say outright they haven't kept the one property that defines the category: a probability that actually tracks accuracy, not just a fast typed answer.answer →Can a decision model work as a guardrail on LLM output before it's sent?Yes. TypeSafe's own guardrail cookbook scores an LLM's replies for things like unsafe advice or policy violations the same way it screens untrusted input.answer →How do I check whether a model's confidence is calibrated on my own traffic?Label a sample of real inputs, run the model, bucket predictions by confidence, and compare each bucket's average confidence to how often it was actually right.answer →How do I pick the confidence threshold for letting a decision run automatically?There's no single number: set a threshold per action based on what a wrong call costs there, using confidence plotted against accuracy on your own labeled data.answer →How is a System One model different from an LLM with structured outputs?Structured outputs make an LLM's text fit your schema. A System One model returns a probability for every answer you allowed, in one pass, trained to track accuracy.answer →What is a System One model?A model that picks one of the answers you defined for a question about some input and returns a probability with it, trained so that probability tracks accuracy.answer →Can a decision model route requests between a cheap LLM and an expensive one?Yes. TypeSafe's own use-case map lists model routing as a built-in pattern: Jev classifies intent, difficulty, and risk, then code escalates the hard cases.answer →Does calibration hold when my production traffic drifts from what the model was trained on?No, not automatically. An independent test of Jev's certified thresholds found the guarantee can miss by 3.6x, or break completely, once traffic shifts.answer →What's the difference between Jev and AWS's Strands Decider?Openness and scale: Strands Decider is open source on a 2B-parameter base; Jev is closed and hosted. Both are System One models picking from fixed options with a confidence score.answer →

Two ways to run Tessary.

Tessary is an open-source agent reliability platform. Cloud and self-hosted run the same workflow on the OpenTelemetry traces your agent already emits.

Tessary Cloud

We host it for you. Send your first trace with nothing to deploy and no model key.

what's includedper organization
traces
10,000 per calendar month
stored trace data
1 GB
retention
30 days
model credit
$10, one-time, for triage and root-cause analysis
credit card
not required

Self-hosted Tessary

Run the open-source code on your own infrastructure with one command. Add your own model key for triage and root-cause analysis.

Self-host Tessary for me by following https://github.com/tessaryai/tessary/blob/main/setup.md

docker compose -f oci://docker.io/tessaryai/tessary:compose up -d -y