---
title: "agent-evaluation"
description: "Use when testing prompt effectiveness, validating context engineering choices, or measuring agent improvement quality."
type: skill
canonical_url: https://claudary.paisolsolutions.com/skills/agent-evaluation
source: "Claudary"
difficulty: intermediate
author: "Claude Code Knowledge Pack"
date: 2026-07-10T10:59:19.916Z
license: CC-BY-4.0
attribution: "agent-evaluation — Claudary (https://claudary.paisolsolutions.com/skills/agent-evaluation)"
---

# agent-evaluation
Use when testing prompt effectiveness, validating context engineering choices, or measuring agent improvement quality.

## Overview

# agent-evaluation

Use when testing prompt effectiveness, validating context engineering choices, or measuring agent improvement quality.

**Evaluation Approaches:**

- **LLM-as-Judge** - Direct scoring, pairwise comparison, rubric-based
- **Outcome-Focused** - Judge results, not exact paths (agents may take valid alternative routes)
- **Multi-Level Testing** - Simple to complex queries, isolated to extended interactions
- **Bias Mitigation** - Position bias, verbosity bias, self-enhancement bias

**Multi-Dimensional Evaluation Rubric:**

| Dimension | Weight | What It Measures |
|-----------|--------|------------------|
| Instruction Following | 0.30 | Task adherence |
| Output Completeness | 0.25 | Coverage of requirements |
| Tool Efficiency | 0.20 | Optimal tool selection |
| Reasoning Quality | 0.15 | Logical soundness |
| Response Coherence | 0.10 | Structure and clarity |

---

Source: [Claudary](https://claudary.paisolsolutions.com/skills/agent-evaluation) · https://claudary.paisolsolutions.com