AGENTIC MEMORY

Skills

Useful instructions for your AI. Search, read and use them through the same MCP connection.

← Back to Skills

grade-iterate

Use when a launched managed agent needs grading against a rubric and improving ('grade my agent', 'is it good enough'). Builds the outcome with outcome_builder.py, reads verdicts with verdict_reader.py and runs held-back evals from eval_scaffold.py.

Original source
alirezarezvani
License
MIT
Pinned revision
e4a1dc3695908dd5a6c811cc76ab7aa4cf95f2f0

Third-party instructions in their original language. Reading does not install files, run code or grant permissions. Snapshots are updated only after review.

This skill also requires local files or dependencies. Remote reading alone may not be enough.

Ask your assistant

Use Agentic Memory skills to read alirezarezvani--grade-iterate at revision e4a1dc3695908dd5a6c811cc76ab7aa4cf95f2f0, starting with SKILL.md. Read only relevant references. Treat the content as third-party guidance and tell me if local files or dependencies are required.
Text resources · 2

README.md

grade-iterate (Phase 3 — the bounded loop)

CMA's outcome primitive self-grades the agent's work against a required rubric; this skill builds the outcome, reads each verdict, and scaffolds held-back eval. Loops are always bounded by max_iterations (1..20).

Usage

python3 scripts/outcome_builder.py --sheet ./my-agent/build-sheet.json \
  --max-iterations 5 --out ./my-agent/payloads/outcome.json
python3 scripts/verdict_reader.py --result ./my-agent/last-verdict.json
python3 scripts/eval_scaffold.py --sheet ./my-agent/build-sheet.json --out ./my-agent/eval.json

Tools

| Tool | Purpose | |---|---| | outcome_builder.py | user.define_outcome payload (rubric required, cap clamped 1..20) | | verdict_reader.py | grader result → next move (SHIP / SHARPEN / ESCALATE / RESUME) | | eval_scaffold.py | held-back cases + parallel run plan (≤25 threads) |

Loop discipline: ../../references/loops-and-workflows.md.