Run History Skill Builder logo

Run History Skill Builder

Community
dongshuyan
run-history-skill-builder

Turn a completed task, browser flow, artifact pipeline, failure-recovery trace, or repeatedly refined workflow into a new reusable skill package or a reviewed skill-design plan. Use when the user asks to make a new skill from real run history, extract a reusable workflow from conversation/logs/files, summarize lessons into a new skill, or produce a plan before writing files. Do not use to upgrade an existing skill or to execute the business workflow itself.

Overview

Publisherdongshuyan
Repositorycompass-skills
Skill namerun-history-skill-builder
Stars
753
Forks
61
Bundled files
9
LicenseMIT
Links
  • Markdown instructions

    A SKILL.md file the model loads on demand, so it only costs tokens when a request actually matches.

  • Works with any LLM

    AI skills are plain Markdown, not provider-specific code, so this works with GPT, Claude, Gemini, Grok, or a local model.

  • 9 bundled files

    Scripts, templates, and references the model can read while it works. Files are read-only and never executed.

  • Open source

    Published by dongshuyan on GitHub. Read the source before you install it.

Installation

Install the Run History Skill Builder AI skill in TypingMind to use it with any LLM, or drop it into another agent that reads SKILL.md.

1

Install in TypingMind

TypingMind installs a skill straight from its GitHub folder — it reads SKILL.md, bundles the resource files, and stores the result locally.

  1. Open the app and go to Plugins → Skills.
  2. Choose "Install from GitHub".
  3. Paste the skill folder URL below and confirm.
    https://github.com/dongshuyan/compass-skills/tree/master/skills/run-history-skill-builder
  4. Enable the skill in any chat where you want it available.
Plugins → Skills → Add skill → From GitHub URL, then paste the folder URL and press Continue.
2

Install in another agent

Any agent that reads the Agent Skills format can use this skill — copy the folder into that agent's skills directory.

Claude Code — .claude/skills
git clone --depth 1 https://github.com/dongshuyan/compass-skills.git /tmp/compass-skills
mkdir -p .claude/skills
cp -r /tmp/compass-skills/skills/run-history-skill-builder .claude/skills/run-history-skill-builder
Restart Claude Code after copying so it picks up the new skill.

Use it in TypingMind

Enable Run History Skill Builder in any TypingMind chat and the model takes it from there. Its name and description sit in the system prompt, and the moment a request matches, the model loads the full instructions itself — you never invoke it by hand, and it costs no tokens until it is actually used.

The model loads Run History Skill Builder on its own as soon as a request matches it.

Works with any AI model

AI skills are plain Markdown instructions rather than provider-specific code, so Run History Skill Builder is not tied to the model it was written for. Install it once in TypingMind and use it with GPT-5, Claude, Gemini, Grok, DeepSeek, Mistral, Llama, or a local model you run yourself — all on your own API keys.

  • Loaded only when it is needed

    The system prompt carries just the name and description. The instructions are fetched on the first matching request, so an idle skill costs nothing.

  • Switch models mid-chat

    Because the skill is instructions rather than code, changing model does not break it — the next model reads the same SKILL.md.

Skill instructions

This is the SKILL.md content the model loads. Read it before installing — a skill is instructions your model will follow.

Run History Skill Builder

Language Policy

Write all user-facing output in the user's language. Default to Chinese when the language is unknown.

Role

Turn real run history into a new skill package, a plan-only skill design, or an upgrade handoff when the request is actually about an existing skill.

Portability

This skill is agent-agnostic. It should work in Codex, Claude Code, OpenCode, OpenClaw, Hermes, and similar local agent hosts that can read SKILL.md plus optional references/, scripts/, evals/, and agents/.

  • Resolve <skill-dir> from the directory that contains this SKILL.md.
  • Let <python> mean the host's available Python launcher: python3, python, or py -3.
  • Do not assume a fixed skill root, shell, home-directory layout, or path separator.
  • Placeholder paths such as <skill-dir>/scripts/... describe path segments, not a required separator style. On Windows, use the separator style that your shell or harness accepts.
  • Before writing files, lock the output directory. If the user does not provide one, propose a neutral local target such as the current repository's skills/ directory or the host agent's documented local skills directory, then wait for confirmation.

Workflow

  1. Lock intent: decide whether the request is plan_only, new_single_skill, router_skill, skill_suite, or existing_skill_upgrade_handoff.
  2. Lock evidence scope: confirm which conversation turns, files, logs, artifacts, diffs, browser flows, or transcripts you may read.
  3. Lock output location before writing files.
  4. Reconstruct the workflow from authorized evidence: user goal, real steps, failures, fixes, success proofs, and approval gates.
  5. Mine local or open-source patterns only when they help package the workflow more reliably.
  6. Separate reusable invariants from local accidentals such as one-time paths, account names, one-day product quirks, or temporary user preferences.
  7. Abstract the workflow into state gates, validation gates, scripts, references, examples, and evals. Delete weak routes that depend on subjective guesses.
  8. Choose the smallest package that preserves correctness.
  9. Write the skill only after the previous gates are satisfied.
  10. Validate, report remaining assumptions, and hand the package back with paths and checks.

Do not jump directly from "I saw a successful run" to "I wrote a skill". The missing middle layer is where portability, privacy, and generalization are decided.

Architecture Choices

  • plan_only: the user wants a reviewed design or audit, not files.
  • new_single_skill: one stable workflow or one tightly coupled workflow family.
  • router_skill: one entry point that routes across several existing skills or phases.
  • skill_suite: several independent workflows that should be released together but triggered separately.
  • existing_skill_upgrade_handoff: the real task is to improve an existing skill. Produce a clean handoff for $run-history-skill-upgrader instead of editing that skill here.

Prefer replacement, merging, and omission over package bloat.

Evidence And Scope

Allowed by default after intent is locked:

  • current visible conversation;
  • user-provided paths, artifacts, logs, screenshots, and transcripts;
  • current workspace files, diffs, tests, and generated outputs;
  • similar public skills or official docs read for packaging patterns.

Require explicit approval before reading:

  • broad local session archives unrelated to the current task;
  • browser cookies, local storage, session exports, or account caches;
  • passwords, tokens, API keys, verification codes, MFA data, or other credentials;
  • unrelated private folders or personal history outside the agreed scope.

Keep facts, inferences, and open assumptions separate. Never write secrets, hidden prompts, private account identifiers, or unrelated personal data into the released skill or its examples.

Design Rules

  • Keep SKILL.md focused on trigger boundary, role, workflow, safety gates, and reference navigation.
  • Put long branch-specific guidance in references/.
  • Put deterministic and repeated checks in scripts/.
  • Put trigger and regression samples in evals/ when the workflow is long-lived, high-risk, or easy to overfit.
  • Use examples only when they capture complex behavior, failure recovery, or boundary conditions. Every example must state the invariant and the non-goal.
  • User-owned decisions stay user-owned. Machine-checkable facts move to scripts, tests, schema checks, diffs, file-existence checks, or validators.
  • Do not create per-skill README, installation scripts, changelogs, or decorative files unless the user or release target explicitly requires them.
  • Treat agents/openai.yaml as an optional UI enhancement, not as the core logic.

Validation

Run the package validator bundled with this skill:

bash
<python> <skill-dir>/scripts/validate_skill_package.py <target-skill-dir>

This bundled validator checks package structure, the portable Agent Skills frontmatter field set, referenced paths, JSON shape, Python syntax, and common private-path leaks. Its dependency-free frontmatter preflight accepts scalar fields, block text, and one-level string metadata; it rejects other YAML forms instead of guessing. A specific host may accept different syntax or a narrower field set, so its canonical validator remains authoritative for installation there. Neither structural check runs the eval cases or proves that the skill triggers correctly or improves behavior.

If the current host provides a canonical skill validator, run that too. On Codex-like hosts, this often means a quick_validate.py command from the platform's skill tooling.

Also run the smallest relevant technical checks:

  • python -m py_compile for modified Python scripts;
  • python -m json.tool for edited JSON files;
  • trigger review with the smallest useful set that includes a should-trigger case, a nearby should-not-trigger case, and a boundary case; add more only when risk or instability warrants it;
  • a leak scan for private absolute paths, credentials, hidden prompts, or environment-specific debris.

Do not claim completion if validation was skipped or failed. Report the gap and the remaining risk.

Final Response

Report:

  • the chosen package type;
  • the final skill path;
  • files created or intentionally omitted;
  • evidence sources actually used;
  • validation commands actually run and their results;
  • assumptions that still need user review;
  • whether the result is plan_only, a new skill package, or an upgrader handoff.

References

  • references/history-mining.md
  • references/open-source-pattern-mining.md
  • references/skill-design-protocol.md
  • references/self-repair-and-evals.md
  • references/examples.md
  • scripts/validate_skill_package.py
  • evals/evals.json

Bundled files

The model reads these on demand while the skill is loaded. They are exposed as readable files and are never executed.

Frequently asked questions

What does the Run History Skill Builder AI skill do?

Turn a completed task, browser flow, artifact pipeline, failure-recovery trace, or repeatedly refined workflow into a new reusable skill package or a reviewed skill-design plan. Use when the user asks to make a new skill from real run history, extract a reusable workflow from conversation/logs/files, summarize lessons into a new skill, or produce a plan before writing files. Do not use to upgrade an existing skill or to execute the business workflow itself.

Why use Run History Skill Builder on TypingMind?

Because you install it once and use it with any model. Run History Skill Builder is plain Markdown rather than provider-specific code, so the same skill runs on GPT-5, Claude, Gemini, Grok, or a local model — and you can switch model mid-chat without it breaking. TypingMind runs on your own API keys, so you pay providers directly instead of a per-seat subscription, and your skills and chats stay in your own storage.

How do I install Run History Skill Builder in TypingMind?

Open Plugins → Skills → Install from GitHub in TypingMind and paste https://github.com/dongshuyan/compass-skills/tree/master/skills/run-history-skill-builder. TypingMind reads its SKILL.md and bundles its files and installs it as a skill you can enable per chat.

Which AI models can use Run History Skill Builder?

Any model you connect in TypingMind. AI skills are plain Markdown instructions rather than provider-specific code, so GPT, Claude, Gemini, Grok, and local models can all load this skill when a request matches it.

How many AI models can I use with Run History Skill Builder?

As many as you like. As long as a model supports skills, you can use Run History Skill Builder with it — GPT, Claude, Gemini, Grok, DeepSeek, Mistral, Llama and more — all on TypingMind with your own API keys.

Is the Run History Skill Builder AI skill free?

Yes. It is published on GitHub by dongshuyan under the MIT license. You only pay your own AI provider for the tokens you use.

What are AI skills?

An AI skill is a reusable instruction bundle that teaches an AI model how to do one specific task. It follows the open Agent Skills format: a SKILL.md file with a name and description, plus any scripts, templates or reference files the model may need. The model reads the instructions only when your request matches the skill, so an installed skill costs nothing until it is used.

How are AI skills different from plugins or MCP servers?

A plugin or MCP server gives a model new tools to call — code that runs somewhere and returns a result. An AI skill gives the model knowledge and process instead: how to approach a task, which steps to follow, what good output looks like. Skills are plain Markdown, so they need no server, no API key and no runtime, and they work with any model.

View all

Set up your own AI workspace now

Get notified about new features and future giveaways by subscribing to our newsletter 👇