Gpt 4 Auto Evaluator For Open Ended Response Grading

via “gpt-4 auto-evaluator for open-ended response grading”

8-dimension trustworthiness benchmark for LLMs.

Unique: Uses GPT-4 as a flexible evaluator for open-ended tasks, with caching to avoid redundant API calls. Parses structured outputs from GPT-4 to enable programmatic aggregation and comparison across models.

vs others: More flexible than pattern-matching evaluators for complex tasks, and more cost-efficient than manual annotation, though introduces evaluator bias that pattern matching avoids.