Skill Creator Skill: Create, Improve & Evaluate Agent Skills

Anthropic's official skill-development skill. Covers creating, improving and measuring Agent Skills: draft, test, evaluate qualitatively and quantitatively, rewrite — plus description optimization for better triggering.

A skill is a reusable asset of agent capability — but writing a skill that works is easy; writing one that triggers accurately and performs reliably is hard. Anthropic's official Skill Creator Skill turns that into an iterable engineering loop: draft, test, evaluate qualitatively and quantitatively, rewrite — until you are satisfied.

The core loop: iterative skill development

  • Capture intent: extract the workflow the user wants to encode from conversation history (tools used, order of steps, corrections made, input/output formats), fill the gaps, and confirm with the user

  • Draft: write a skill draft — decide what it should do and roughly how

  • Test: write a few test prompts and run the skill-equipped agent to observe real behavior

  • Evaluate qualitatively & quantitatively: judge output quality subjectively, and back it with benchmarks/variance analysis; show results via the eval-viewer

  • Rewrite & iterate: rewrite from feedback, grow the test set, and repeat until converged

The optional bonus: description optimization

Once a skill is done, Skill Creator can also run a separate description improver script to optimize the skill's description — this step directly drives triggering accuracy: a well-written description makes the agent pull up the right skill in the right context. For skills that already exist, you can skip straight to the evaluation/iteration loop.

Communication discipline: clear for anyone

The skill stays sensitive to the audience: it may range from a developer's teammate to someone opening a terminal for the first time. By default words like "evaluation" and "benchmark" are borderline-but-OK; terms like "JSON" and "assertion" should only appear once the user shows they know them, otherwise give a short definition. Better to over-explain than to lose the user.

Typical use cases

  • Codify team workflows: turn repeatedly manual work (sending reports, querying data, writing copy) into a skill — write once, reuse forever

  • Improve existing skills: when a skill performs inconsistently, use the eval loop to find weak spots and rewrite deliberately

  • Quantitative validation: prove a skill version is genuinely more stable with benchmarks and variance analysis, not vibes

How to use & download

Claude Code users: drop skills/skill-creator into your project's .claude/skills/ folder. Describe the skill you want to create or improve and the agent walks you through the whole loop. Full source: official GitHub repo.

Other agent users: follows the standard SKILL.md convention. Official docs: Anthropic Agent Skills documentation.

Related resources

Skill development and use form a loop: this skill builds skills, ACP Router (acp-router) loads them into the right coding-agent environment, and MCP server development (mcp-builder) supplies the underlying tools.