critic-loop skill
✓ VerifiedRuns an independent critic loop to score and refine non-code generated work like images, video frames, and copy against a predefined rubric.
- GitHub stars
- 5
- Files
- 4
- Last commit
- Nov 4, 2026
- License
- MIT
- Allowed tools
- —
What does the critic-loop skill do?
critic-loop runs an independent critic loop to score and refine non-code generated work like images, video frames, and copy against a predefined rubric.
Summary generated from the skill's SKILL.md.
About the critic-loop skill
Refining visual and written assets through independent evaluation is what critic-loop enables for creative developers and content producers. This skill runs an automated, multi-round review process for non-code artifacts such as images, video frames, renders, ASCII art, and marketing copy. It functions by deploying fresh, context-blind agents to act as critics, ensuring the reviewer has no prior knowledge of the producer's intent or reasoning. This separation prevents the bias that occurs when a creator grades their own work.
Users initiate the process by defining a rubric that includes a brief, scoring categories, and blocking conditions. The skill manages a structured lifecycle of blind reads, scored verdicts, and triage. It supports advanced configurations like running two critics from different model families to find the lower score for higher quality control. The process continues through iterative revision rounds until a specific threshold is met, a round limit is reached, or the work stalls. All review evidence, including the rubric and individual round reports, is stored in a dedicated directory within the target repository.
What an agent can do with it
- 1Evaluate image generation qualityHave an independent critic score a rendered image against a specific rubric to ensure it matches the intended subject and mood.
- 2Review video frame consistencyAnalyze extracted video frames and contact sheets to identify visual gaps or errors in motion and composition.
- 3Refine marketing copyUse a blind read to determine if the intended message and audience of a text artifact are actually perceived by a stranger.
- 4Automate creative quality gatesSet a scoring threshold that must be reached before any generated visual or text is presented to the owner as ready.
Written from the skill's SKILL.md. Every use case is checked against a quote from it.
How to install the critic-loop skill
Each command copies the skill folder into the client's skills directory. Restart the client or start a new session to load it.Install the critic-loop skill in Plugin
/plugin marketplace add augchan42/inkstone /plugin install inkstone@augchan42-inkstone
Install the critic-loop skill in Claude Code
~/.claude/skills/critic-loop/SKILL.md
$ npx degit augchan42/inkstone/skills/critic-loop ~/.claude/skills/critic-loopInstall the critic-loop skill in Claude Code (project)
.claude/skills/critic-loop/SKILL.md
$ npx degit augchan42/inkstone/skills/critic-loop .claude/skills/critic-loopInstall the critic-loop skill in Codex
~/.agents/skills/critic-loop/SKILL.md
$ npx degit augchan42/inkstone/skills/critic-loop ~/.agents/skills/critic-loopInstall the critic-loop skill in Gemini CLI
~/.gemini/skills/critic-loop/SKILL.md
$ npx degit augchan42/inkstone/skills/critic-loop ~/.gemini/skills/critic-loopInstall the critic-loop skill in Claude.ai
npx degit augchan42/inkstone/skills/critic-loop critic-loop && zip -r critic-loop.zip critic-loop # claude.ai → Customize → Skills → + → Create skill → Upload a skill → critic-loop.zip
Automated checks
Ran Nov 16, 2026Full report →Passed our automated checks. That is not a security audit: read the scripts before you let an agent run them. How checks work
- Source repository linked and reachableaugchan42/inkstone/skills/critic-loop is public and reachablegithub.com/augchan42/inkstone/tree/HEAD/skills/critic-loop ↗Pass
- Open source license (OSI)MITspdx.org/licenses/MIT.html ↗Pass
- Commit or release in the last yearLast commit 2026-11-04github.com/augchan42/inkstone/commits ↗Pass
- No download-and-run or credential theft in scriptsNo scripts in the skill folderPass
- No hidden instructions in SKILL.mdNo override phrases, safeguard switches, credential requests or hidden charactersgithub.com/augchan42/inkstone/blob/HEAD/skills/critic-loop/S ↗Pass
- Pre-approved tools are scopedNo pre-approved tools; the agent asks before using onegithub.com/augchan42/inkstone/blob/HEAD/skills/critic-loop/S ↗Pass
- SKILL.md follows the Agent Skills formatValid name and description; says when to use it; 248 linesgithub.com/augchan42/inkstone/blob/HEAD/skills/critic-loop/S ↗Pass
SKILL.md
View on GitHubCritic Loop
An independent critic for generated work. The producer makes the work; a critic that has never seen the producer's reasoning judges it; the producer revises; the loop stops by rule, not by feel.
Core principle: the producer's own check is not a review. An agent that drew a ram believes it drew a ram, and grades the picture with that belief. Only a critic that has not been told what the picture is can say whether it shows one.
When to use, and when not
- Use for anything whose quality is judged by looking or reading: stills, renders, contact sheets, video frames, covers, ASCII or canvas art, UI screenshots judged as pictures, captions, short copy.
- Code changes:
codex-review. Implementation plans:plan-review-loop. Whether code meets its intent:verify-change. - Skip it for a trivial change to work that already passed. Zero rounds is a valid outcome; say so.
Lifecycle
rubric → round: packet → blind read → scored verdict → triage → revise → … → stop rule → report
Records live in reviews/critic/<id>/ in the target repo: rubric.md, round-<n>.md per
round, summary.md at the end. They are the only state; there is no hook. If the project
already keeps review evidence somewhere (for example a short's
docs/research/<date>-<slug>/ with review-r1-sol.txt), put the records there instead and
keep the same file roles.
Phase 1 — Rubric, before round 1
Write reviews/critic/<id>/rubric.md before the critic sees anything. A rubric
written after looking at the work bends to fit it.
The rubric holds:
- The brief: what the work must show or say, in one or two sentences, and its viewing condition (phone at feed size, a 120-column canvas, a 9:16 cover crop). Add the owner's standing taste and past verdicts on earlier versions where they exist; they are part of the brief, so the critic gets them after the blind read.
- Categories, in one of two forms. Start from the matching rubric in
rubrics.md and change it to fit the work. Every category names what a
full score looks like.
- Total: categories with maximum scores totalling 10; the round passes on the total.
- Per dimension: each dimension scored 1–10 on its own; the round passes only when every applicable dimension reaches the threshold. Use this when the project scores that way (a production-rules file that says "every applicable rating at least 8"). Name the dimensions the artifact cannot show yet — motion and sound cannot be judged from stills. They are recorded as PENDING, never scored, until a moving, audible test exists.
- Blocking conditions: failures that block a pass at any score — the blind read names a different subject; essential text is unreadable at the viewing size; a content rule from the project is broken.
- Threshold (default 8), max rounds (default 5).
- References (optional): reference examples the owner or the style chose — a style guide's sample images, an approved earlier short, the owner's verdicts on past versions. They are part of the brief.
If the project has its own rule for a critic (a production-rules file, an ADR), read it and follow its threshold and gates; it overrides these defaults.
Show the owner the rubric when the work is new or the rubric is new. Do not wait for an answer to start; record that it was shown.
Phase 2 — The packet
Each round's critic is a fresh agent. Honor an explicit user/project or calling workflow's backend/model selection before the defaults in ../codex-review/reviewer-backends.md. Without a selected route, retain the shared default order: Codex CLI, then opencode, then context-blind subagents. A critic of pictures must receive the pictures:
- Codex CLI:
codex --sandbox read-only exec -i <png> [-i <png> …] --output-last-message "$CRITIC_PHASE_FILE" "<prompt>" < /dev/null - When a caller selects Astra at Ultra, add
--model gpt-6-astra -c 'model_reasoning_effort="ultra"'; use a fresh call for each blind-read and scored-verdict stage. - Claude Code CLI: use references/claude-code.md for subscription authentication, image reading, restricted tools and captured results.
- opencode:
opencode run --pure --agent inkstone-reviewer -f <png> … "<prompt>" < /dev/null - Subagent: give it the image paths and tell it to read them.
A backend that cannot take images is skipped for default visual routing; log why. If a selected backend/model cannot run, keep its review incomplete and report the reason; do not silently replace it or reduce a required two-critic round to one. Record the critic as tool and model, and say when it is the same model family as the producer.
Allocate a fresh absolute output path for each critic, phase and round, such
as round-1.codex.blind.md and round-1.codex.verdict.md. Never send multiple
calls to the same output path. The host preserves those results and assembles
the combined round-<n>.md record with both verdicts and dispositions.
The packet contains, and only contains:
- the artifact (images, frames, text) at the size it will be seen;
- the rubric, with the brief held back for the blind read (Phase 3);
- the references, given with the brief after the blind read;
- from round 2: the previous round's artifact and verdict, and a one-line list of what changed. In two-critic mode, give each critic only its own previous verdict; withhold the other critic's verdict and the combined scores. Not the producer's reasons for the changes.
For video, the artifact is frames, not the producer's description of them — see Video and shorts.
Never send the producer's conversation, its notes on what it was trying to do, or its own assessment. Those are the reasoning the critic exists to be free of.
Use critic-prompt.md for the prompt.
Two critics (--critics 2, or when the project asks for it): run two fresh critics
from different model families on the same packet, each blind to the other (for example
a Claude subagent and Codex CLI on a GPT model). The round's total is the lower of the
two — per dimension, the lower score in each; a blocking condition from either blocks. Changes both
critics ask for go first; a finding only one raises is still dispositioned.
Both critics must complete before the combined result can pass. Keep their blind
reads separate and give each scored-verdict call only its own blind read.
Phase 3 — Blind read
The critic first answers, from the artifact alone: what does this show (or say)? Name the subject, the action and the mood, as a stranger would.
Only then does it receive the brief, and compare. A blind read that names a different subject is blocking, whatever the scores — a lake that reads as two eyes has failed, however good its ripples are.
For text, the blind read is: what is this saying, and to whom?
Phase 4 — Scored verdict
The critic scores each category, may use halves, and lists every gap that keeps each
category from full marks, each one specific enough to act on ("the horns merge into
the hedge at cells 40–55", not "the ram looks off"). It totals out of 10 and ends with a
verdict: PASS, REVISE or RETHINK (the approach cannot reach the threshold by
adjustment; say what to change).
Rules the prompt gives the critic:
- Be exact and do not soften. A regression scores lower than the round before.
- Stay consistent with the previous verdict, but you are not bound to match or raise its score.
- Ignore preferences that do not affect whether the work meets the brief.
- A fixed bug does not by itself earn a higher score. Score the work as it now is.
- Do not score a PENDING dimension, and do not infer it from what is shown.
With two critics, record each critic's scores and reasons separately in the round file, then the combined result; never only the combined number.
The round's record is reviews/critic/<id>/round-<n>.md; check it exists, is non-empty
and names the critic before accepting it.
Phase 5 — Triage
The producer judges every finding and records one line per finding under
## Disposition in the round file:
- ACCEPTED — will change it this round.
- DECLINED — with the reason (e.g. "deliberate: the brief asks for night; the critic wants it brighter").
A critic is confidently wrong sometimes; a producer who accepts every finding did not read them. A blocking condition cannot be declined — only met or escalated to the owner.
Write each accepted finding as a revision note: where (a timestamp or frame number for video, cells or coordinates for a still), one change, and the visible result expected. Fix the largest gaps first; where the project says how many per round (the studio's "fix the three worst problems and repeat"), fix that many and no more, so the next round can tell what helped. Re-render the same samples after the fixes, so the critic compares like with like.
Phase 6 — Stop rules
After each round, in this order:
- Pass: total ≥ threshold, no blocking condition, every finding dispositioned → stop. Notes the critic left that were declined stay in the record.
- Stall approaching: the best total has not risen a full point in 2 rounds, or the critic names the same gap twice in a row → no more adjustments. Rethink: a different composition, subject treatment or structure, then run the next round on that.
- Stalled: the rethink scores the same or lower → stop and ask the owner whether the current best is good enough, with its round file.
- Round limit: max rounds reached → stop and report the best round and its open gaps.
- Otherwise: revise and run the next round.
Keep the best-scoring version; a later round that regressed does not replace it.
Video and shorts
A critic cannot watch a video through most backends; it gets frames. Extract them from the file that will be delivered (after any cover, bookend or compression pass), not from a preview render:
- Frame zero:
ffmpeg -i delivery.mp4 -frames:v 1 frame-zero.png, plus the profile-grid crops the platform uses (the studio: centre 1:1 and 3:4). The cover and the frames that follow it (the studio: frames 30–50) are scored as their own items. - Beat contact sheet: one frame per beat on the beat grid, labelled with its time.
- Shot states: the first, middle and last frame of each shot.
- Action strips: consecutive frames around each important action and each cut, so a contact error or a jump shows.
- Crops: full-resolution crops of faces, hands, feet and object contacts.
Send them at phone size as well as full size. Motion and sound stay PENDING until the critic is given a moving, audible test it can judge (or the owner judges it); say which.
Where the project defines its own dimensions (hook in the first 2 seconds, phone readability, motion, variety, brand accuracy, sound sync; for a series, its own replacements), use them as the per-dimension rubric. See rubrics.md.
Batches
For many artifacts (a set of 64 scenes, a contact sheet of beats):
- One rubric for the set, with a per-item brief. A short's cover, exit and body can be items of one batch.
- One critic per item, each fresh. Do not let one critic score a set and drift across it.
- Run a first round over every item, then loop only the items that did not pass.
summary.mdholds a table: item, best total, rounds, verdict, open gaps.
Report
Lead with: the verdict, the rounds run, the best total (or each dimension's best score), the critic (tool and model, same-family or not), and any PENDING dimensions. Then the open gaps of anything that did not pass, then the paths of the records and the final images. Never call a piece passed on the producer's own check.
Rules
- Rubric before round 1. Brief held back until the blind read.
- A fresh critic every round; never the producer's reasoning in the packet.
- The critic sees the work at its real viewing size; video as frames from the delivery file.
- PENDING dimensions are never scored from stills.
- Every finding gets a disposition; blocking conditions are met or escalated.
- Stop by the stop rules; a pass is not approval to publish or merge — the owner's gates still apply.
- On a tooling failure, report it and say plainly that the round did not run.
Files in this skill
4critic-loop skill questions
How do I install the critic-loop skill in Claude Code?
Run npx degit augchan42/inkstone/skills/critic-loop ~/.claude/skills/critic-loop. Claude Code loads skills from ~/.claude/skills (all projects) or .claude/skills (one project) and uses a skill when its description matches the task.
Which clients can use the critic-loop skill?
Any client that reads the Agent Skills format: Claude Code, Codex, Gemini CLI and claude.ai (upload as a ZIP). Scripts in the skill run only where the client allows code execution.
What kind of work can the critic loop evaluate?
It is designed for non-code artifacts such as images, renders, ASCII art, video stills, frames, shorts, covers, and copy.
How does the critic avoid bias from the producer?
The critic performs a 'blind read' where it describes what it sees before being told the intended brief or purpose.
When does the critic loop stop?
The loop terminates when a quality threshold is met, a stall rule is triggered, or the maximum number of rounds is reached.
Can this tool be used for code reviews?
No, for code changes you should use codex-review, and for implementation plans, use plan-review-loop.