All skills
Skillintermediate

agent-evaluation

Use when testing prompt effectiveness, validating context engineering choices, or measuring agent improvement quality.

Claude Code Knowledge Pack7/10/2026

Overview

agent-evaluation

Use when testing prompt effectiveness, validating context engineering choices, or measuring agent improvement quality.

Evaluation Approaches:

  • LLM-as-Judge - Direct scoring, pairwise comparison, rubric-based
  • Outcome-Focused - Judge results, not exact paths (agents may take valid alternative routes)
  • Multi-Level Testing - Simple to complex queries, isolated to extended interactions
  • Bias Mitigation - Position bias, verbosity bias, self-enhancement bias

Multi-Dimensional Evaluation Rubric:

DimensionWeightWhat It Measures
Instruction Following0.30Task adherence
Output Completeness0.25Coverage of requirements
Tool Efficiency0.20Optimal tool selection
Reasoning Quality0.15Logical soundness
Response Coherence0.10Structure and clarity