What's the difference between faithfulness, groundedness, and context presence?

Faithfulness asks whether the answer matches the source it cites, groundedness whether the answer came from the retrieved context at all, and context presence whether that context was retrieved in the first place.

They fail at different stages. Context presence fails in retrieval, before the model has written a word. Groundedness and faithfulness both fail in generation: an ungrounded answer came from the model’s own prior with the context sitting unused, which can still be correct whenever that prior happens to be right, and an unfaithful answer read the source and misrepresented it. None of the three says whether the retrieved source is itself accurate.

Knowing which one fired tells you where to look. A faithfulness failure means fix the generation step; a context-presence failure means fix retrieval.

keep reading

More on this.

Two ways to run Tessary.

Tessary is an open-source agent reliability platform. Cloud and self-hosted run the same workflow on the OpenTelemetry traces your agent already emits.

Tessary Cloud

We host it for you. Send your first trace with nothing to deploy and no model key.

what's includedper organization
traces
10,000 per calendar month
stored trace data
1 GB
retention
30 days
model credit
$10, one-time, for triage and root-cause analysis
credit card
not required

Self-hosted Tessary

Run the open-source code on your own infrastructure with one command. Add your own model key for triage and root-cause analysis.

Self-host Tessary for me by following https://github.com/tessaryai/tessary/blob/main/setup.md

docker compose -f oci://docker.io/tessaryai/tessary:compose up -d -y