What regressions will a CI gate never catch?

Any regression whose cause never shows up in a diff. A CI gate runs the modified agent against a set of checks before a change merges, so its whole method depends on there being a change in the branch to run against. A provider updating the model behind a stable API name, a dependency’s behavior shifting on its own release schedule, or a downstream service changing its response format all regress an agent with nothing in any pull request to point the gate at. A CI gate was built to check a change your team is about to ship, so a regression with no diff behind it simply falls outside what that check can see. That’s why production monitoring exists as its own practice, separate from pre-merge testing: it watches what the agent actually does on a rolling basis, and catches a regression the gate never had a diff to run.

keep reading

More on this.

Two ways to run Tessary.

Tessary is an open-source agent reliability platform. Cloud and self-hosted run the same workflow on the OpenTelemetry traces your agent already emits.

Tessary Cloud

We host it for you. Send your first trace with nothing to deploy and no model key.

what's includedper organization
traces
10,000 per calendar month
stored trace data
1 GB
retention
30 days
model credit
$10, one-time, for triage and root-cause analysis
credit card
not required

Self-hosted Tessary

Run the open-source code on your own infrastructure with one command. Add your own model key for triage and root-cause analysis.

Self-host Tessary for me by following https://github.com/tessaryai/tessary/blob/main/setup.md

docker compose -f oci://docker.io/tessaryai/tessary:compose up -d -y