# What changed in the latest version of tau-bench?

The latest version, tau3-bench, released March 18, 2026, added two domains: banking, where the answer sits inside 698 documents across 21 product categories rather than one lookup, and voice, where the same tasks get spoken instead of typed. The best model tested, GPT-5.2 at high reasoning, completes about a quarter of the banking tasks, and a voice agent that hits 85% on the text version of a task drops to 26 to 38% saying it out loud.

The version before it, tau2-bench, changed something more basic: the simulated customer could act on the environment, restarting their phone or turning off airplane mode, not just talk, and it added a telecom domain built around that. The paper reports a significant drop in success once agents had to guide a person instead of just answering one, [the same kind of consistency gap ReliabilityBench measures](/answers/reliabilitybench/how-do-you-measure-whether-an-agent-succeeds-consistently) by running a task more than once instead of trusting a single pass.

---

Sources:
- Sierra, "τ³-Bench: Advancing agent evaluation to knowledge and voice": https://sierra.ai/blog/bench-advancing-agent-benchmarking-to-knowledge-and-voice (fetched 2026-09-21)
- τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment (arXiv:2506.07982): https://arxiv.org/abs/2506.07982 (fetched 2026-09-21)

Source: https://tessary.ai/answers/tau-bench/what-changed-in-the-latest-version-of-tau-bench
More on Tau bench: https://tessary.ai/answers/tau-bench
From Tessary, agent reliability for AI agents in production: https://tessary.ai
