# Is there a benchmark built specifically for multi-agent systems?

Yes. ST-Bench runs real scientific data-analysis tasks, adapted from published Earth-science studies, against both single agents and several multi-agent setups on the same model. Nine of the ten multi-agent configurations it tested beat the cheapest single-agent baseline, and the strongest one scored nearly three times higher on its composite metric, at roughly four times the inference cost. A cheaper multi-agent setup captured most of that gain for under twice the cost.

The gain came from coverage, not accuracy: a multi-agent setup produced a usable, well-formed numerical answer on more of the queries, while the quality of those answers, once produced, matched the single-agent baseline. So [a benchmark score here isn't saying a multi-agent architecture reasons better](/answers/agent-harness/does-a-better-harness-matter-more-than-a-better-model); it's saying more of its attempts land a complete answer instead of giving up or returning something unusable.

That's one study on one task family. Whether the same tradeoff holds on a task that isn't scientific data analysis is still untested.

---

Sources:
- ST-Bench: A Spatial-Temporal Benchmark for Multi-Agent System Generation on Scientific Research Tasks (arXiv:2610.07763): https://arxiv.org/abs/2610.07763 (fetched 2026-10-08)

Source: https://tessary.ai/answers/agent-benchmarks/is-there-a-benchmark-for-multi-agent-systems
More on Agent benchmarks: https://tessary.ai/answers/agent-benchmarks
From Tessary, agent reliability for AI agents in production: https://tessary.ai