Does Jev beat a frontier LLM's accuracy on the same task?

On TypeSafe’s own benchmark across four example workflows, security incidents, trace observability, invoice processing, and customer service, Jev averaged 67.8% accuracy at $0.0004 and 0.4 seconds per case, beating Claude Opus 5 answering the same decisions as a single prompt, which scored 64.8% at $0.34 and 70.5 seconds.

Jev isn’t the most accurate point on the chart: Opus 5 and Sol, another model TypeSafe tested, score higher, 73.1% and 74.1%, once restructured from one prompt into TypeSafe’s own multi-step workflow, which beat the single-prompt version of every model tested on accuracy, cost, and time. What Jev wins outright is cost and speed, roughly two orders of magnitude cheaper and faster than any prompted model on the chart, the same cost asymmetry that favors a classifier over an LLM judge for a narrow, closed-answer question. These are TypeSafe’s own numbers, on its own four example tasks, not an independent benchmark.

sources

keep reading

More on this.

Two ways to run Tessary.

Tessary is an open-source agent reliability platform. Cloud and self-hosted run the same workflow on the OpenTelemetry traces your agent already emits.

Tessary Cloud

We host it for you. Send your first trace with nothing to deploy and no model key.

what's includedper organization
traces
10,000 per calendar month
stored trace data
1 GB
retention
30 days
model credit
$10, one-time, for triage and root-cause analysis
credit card
not required

Self-hosted Tessary

Run the open-source code on your own infrastructure with one command. Add your own model key for triage and root-cause analysis.

Self-host Tessary for me by following https://github.com/tessaryai/tessary/blob/main/setup.md

docker compose -f oci://docker.io/tessaryai/tessary:compose up -d -y