Hallucination And Faithfulness Detection With Reference Based And Reference Free Evaluation

via “hallucination and faithfulness detection with reference-based and reference-free evaluation”

AI testing for quality, safety, compliance — vulnerability scanning, bias/toxicity detection.

Unique: Implements both reference-based hallucination detection (comparing against ground truth or context) and reference-free detection (LLM-as-judge evaluation), enabling hallucination detection in scenarios with or without reference answers. For RAG systems, it measures faithfulness by checking if outputs are supported by retrieved documents.

vs others: More comprehensive than simple entailment-based approaches because it detects multiple hallucination types (contradictions, fabrications, out-of-context claims) and provides both reference-based and reference-free detection methods, rather than relying on a single evaluation approach.