How long before a call site's baseline is worth anything?

Once each side of the comparison holds roughly 150 comparable turns, the default sample size the duration and cost detectors wait for before calling anything a deviation. There’s no fixed schedule behind that number: it’s a sample-size threshold, not a calendar one. A call site hit on every request clears it in minutes; one on a rare code path can take real wall-clock time, because the count comes from traffic as it actually arrives, never backfilled from history you already had. Baselines are also scoped per call site on purpose: pooling traffic across call sites would let one call site’s normal noise hide another’s real drift, so a low-volume call site waits on its own clock regardless of how busy the rest of your agent is. Silence from a freshly tagged call site almost always means the baseline is still building, not that nothing’s wrong; the sample count is visible while it climbs.

keep reading

More on this.

Send us the traces you already emit.