Does a correct multi-agent answer mean nothing broke?

No, and which rule breaks decides how often it slips through. A study replayed multi-agent runs with one coordination rule broken at a time: whether information reaches the agent that needs it (routing), whether accepted evidence is weighted correctly against duplicate reports (admission), whether shared state stays current, and whether a correct decision gets carried out (action). Breaking routing, state, or action always produced a visibly wrong answer, in all 72 trials each. Breaking admission, treating two copies of one report as independent confirmation instead of catching the duplicate, still let the system land on the correct answer in 43 of 72 trials, with nothing in the final answer or the transcript showing anything had gone wrong.

Diagnosing the break afterward needed the same access the system itself did: reading only the public output caught 26% of the broken rules; reading each framework’s own internal records, the admission log, the state before and after an update, raised that to 63%. Grading each agent’s output separately misses the same kind of break, since a run that lands on the right answer gives no sign its coordination already failed. It’s a single-author preprint three days old, early evidence rather than settled.

sources

keep reading

More on this.

Two ways to run Tessary.

Tessary is an open-source agent reliability platform. Cloud and self-hosted run the same workflow on the OpenTelemetry traces your agent already emits.

Tessary Cloud

We host it for you. Send your first trace with nothing to deploy and no model key.

what's includedper organization
traces
10,000 per calendar month
stored trace data
1 GB
retention
30 days
model credit
$10, one-time, for triage and root-cause analysis
credit card
not required

Self-hosted Tessary

Run the open-source code on your own infrastructure with one command. Add your own model key for triage and root-cause analysis.

Self-host Tessary for me by following https://github.com/tessaryai/tessary/blob/main/setup.md

docker compose -f oci://docker.io/tessaryai/tessary:compose up -d -y