General agent concepts

Hallucinations

A hallucination is an agent stating something its sources don't support. The term covers three distinct properties of an answer, and each one can be checked on its own.

Faithfulness asks whether the answer accurately represents the sources it cites. An agent can retrieve the right document and still misquote it, invert a number, or attribute a claim the document doesn't make.

Groundedness asks whether the answer comes from the retrieved context or from the model's own priors, with the context left unused. An ungrounded answer can be correct whenever the prior happens to be right, which makes it hard to notice, and it fails when the prior is wrong.

Context presence asks whether the information needed to answer was retrieved at all. When it wasn't, the failure is in the retrieval step, before generation begins.

Hallucination is a problem because a made-up answer looks the same as a right one. The person asking usually can't verify it themselves, and if the answer feeds a decision or another agent, the made-up fact gets acted on.

6 questions

Answered, plainly.

How can an answer be faithful to its context and still be wrong?Faithfulness only checks the answer against what was retrieved, so an answer built entirely from a partial or unrepresentative slice of the source passes even though it's wrong.answer →What's the difference between faithfulness, groundedness, and context presence?They check three different points in the same pipeline: was the needed source retrieved, did the model actually use it, and did it represent that source accurately once it did.answer →How do I catch agent hallucinations when my error rate stays flat?Error rate tracks whether a run crashed, not whether its answer was true, so you need a check that compares the answer's content against its actual sources instead.answer →What is a hallucination in an AI agent?An agent stating something its sources don't support, whether it misquotes a document it retrieved, ignores that document entirely, or never retrieved anything to begin with.answer →Why do AI agents hallucinate?A language model generates the most probable next word, not a verified one, so it produces fluent text whether or not anything backs it, unless something forces it to check.answer →Why does a wrong answer often look just as confident as a right one?Nothing about how an answer reads reveals where it came from; a number pulled from the wrong source is written in the same fluent, certain sentence as one pulled from the right one.answer →

Send us the traces you already emit.

book a demo