How does a CI eval job avoid stacking a new comment on every push?

It edits its own prior comment in place instead of posting a new one on every push. Every comment Tessary’s CI gate renders carries a stable marker embedded in the body, and the sample GitHub Action wires that up to a comment-upsert step, matched by comment author, that replaces the existing comment’s text rather than adding a new one below it.

Each push to the PR still triggers a fresh report from the server, but the thread only ever shows the latest verdict, not a growing stack of one per commit. This depends on the CI job actually using an upsert action rather than a plain “create comment” call. The marker exists so a job can look up its own prior comment and know it’s the one to replace, but the job still has to do that look-up; nothing on the platform side enforces it.

keep reading

More on this.

Two ways to run Tessary.

Tessary is an open-source agent reliability platform. Cloud and self-hosted run the same workflow on the OpenTelemetry traces your agent already emits.

Tessary Cloud

We host it for you. Send your first trace with nothing to deploy and no model key.

what's includedper organization
traces
10,000 per calendar month
stored trace data
1 GB
retention
30 days
model credit
$10, one-time, for triage and root-cause analysis
credit card
not required

Self-hosted Tessary

Run the open-source code on your own infrastructure with one command. Add your own model key for triage and root-cause analysis.

Self-host Tessary for me by following https://github.com/tessaryai/tessary/blob/main/setup.md

docker compose -f oci://docker.io/tessaryai/tessary:compose up -d -y