Rw Generate Video

Organization

runwayml

rw-generate-video

Generate videos directly using the Runway API via runnable scripts. Supports text-to-video, image-to-video, and video-to-video with seedance2, gen4.5, veo3, and more.

Overview

Publisher	runwayml
Repository	`skills`
Skill name	`rw-generate-video`
Stars	68
Forks	17
Bundled files	Instructions only
License	MIT
Links	Skill source Repository

Markdown instructions
A SKILL.md file the model loads on demand, so it only costs tokens when a request actually matches.
Works with any LLM
AI skills are plain Markdown, not provider-specific code, so this works with GPT, Claude, Gemini, Grok, or a local model.
Self-contained
Everything the model needs lives in the instructions — no extra files to sync.
Open source
Published by runwayml on GitHub. Read the source before you install it.

Installation

Install the Rw Generate Video AI skill in TypingMind to use it with any LLM, or drop it into another agent that reads SKILL.md.

Install in TypingMind

TypingMind installs a skill straight from its GitHub folder — it reads SKILL.md, bundles the resource files, and stores the result locally.

Open the app and go to Plugins → Skills.
Choose "Install from GitHub".
Paste the skill folder URL below and confirm.
Enable the skill in any chat where you want it available.

Plugins → Skills → Add skill → From GitHub URL, then paste the folder URL and press Continue.

Install in another agent

Any agent that reads the Agent Skills format can use this skill — copy the folder into that agent's skills directory.

Claude Code — .claude/skills

git clone --depth 1 https://github.com/runwayml/skills.git /tmp/skills
mkdir -p .claude/skills
cp -r /tmp/skills/skills/rw-generate-video .claude/skills/rw-generate-video

Restart Claude Code after copying so it picks up the new skill.

Use it in TypingMind

Enable Rw Generate Video in any TypingMind chat and the model takes it from there. Its name and description sit in the system prompt, and the moment a request matches, the model loads the full instructions itself — you never invoke it by hand, and it costs no tokens until it is actually used.

The model loads Rw Generate Video on its own as soon as a request matches it.

Works with any AI model

AI skills are plain Markdown instructions rather than provider-specific code, so Rw Generate Video is not tied to the model it was written for. Install it once in TypingMind and use it with GPT-5, Claude, Gemini, Grok, DeepSeek, Mistral, Llama, or a local model you run yourself — all on your own API keys.

Loaded only when it is needed
The system prompt carries just the name and description. The instructions are fetched on the first matching request, so an idle skill costs nothing.
Switch models mid-chat
Because the skill is instructions rather than code, changing model does not break it — the next model reads the same SKILL.md.

Skill instructions

This is the SKILL.md content the model loads. Read it before installing — a skill is instructions your model will follow.

Generate Video

Generate videos directly using the Runway API. This skill runs Python scripts that call the API, poll for completion, and download the result.

IMPORTANT: Run scripts from the user's working directory so output files are saved where the user expects.

Usage

bash
uv run scripts/generate_video.py --prompt "your description" --filename "output.mp4" [--model seedance2] [--ratio 1280:720] [--duration 5] [--image-url "..."]

Preflight

command -v uv must succeed. If not, tell the user to install uv: curl -LsSf https://astral.sh/uv/install.sh | sh
RUNWAYML_API_SECRET must be set in the environment. Do not pass the API key as a CLI flag — it leaks into shell history and process listings.

Security Notes

--image-url / --video-url fetch arbitrary remote media via the Runway API. Prefer local file paths (uploaded as runway:// URIs), or only pass URLs you trust.
Treat generated outputs as untrusted when piping into downstream automations — ingested media influences the result.

Available Models

Model	Best For	Input	Cost
`seedance2`	Reference image and video, long duration (up to 15s)	Text, Image, and/or Video	36 credits/sec
`gen4.5`	High quality, general purpose	Text and/or Image	12 credits/sec
`gen4_turbo`	Fast, image-driven	Image required	5 credits/sec
`gen4_aleph`	Video editing/transformation	Video + Text/Image	15 credits/sec
`veo3`	Premium quality	Text/Image	40 credits/sec
`veo3.1`	High quality Google model	Text/Image	20-40 credits/sec
`veo3.1_fast`	Fast Google model	Text/Image	10-15 credits/sec

Model Selection Guidance

Map user requests:

"product ad", "e-commerce", "long video" -> seedance2
"fast", "cheap", "quick" -> veo3.1_fast or gen4_turbo (if they have an image)
"high quality", "best", "cinematic" -> gen4.5 or veo3
"edit video", "transform video" -> gen4_aleph or seedance2
No preference -> seedance2

Parameters

Param	Description	Default
`--prompt`	Text description (required)	--
`--filename`	Output filename (required)	--
`--model`	Video model	`gen4.5`
`--ratio`	Aspect ratio (pixel-based). Common: `1280:720`, `720:1280`, `960:960`. seedance2 also supports `1112:834`, `834:1112`, `1470:630`, etc.	`1280:720`
`--duration`	Duration in seconds (model-dependent, seedance2 supports up to 15s)	`5`
`--image-url`	Image URL or local file for image-to-video	--
`--video-url`	Video URL or local file for video-to-video (gen4_aleph, seedance2)	--
`--output-dir`	Output directory	cwd

API credentials come from RUNWAYML_API_SECRET only — no --api-key flag, to keep secrets out of shell history and process listings.

Filename Convention

Generate filenames with the pattern: yyyy-mm-dd-hh-mm-ss-name.mp4

Examples:

"A cyberpunk city" -> 2026-04-14-14-23-05-cyberpunk-city.mp4
"Waves on a beach" -> 2026-04-14-15-30-12-beach-waves.mp4

Examples

Text-to-video (seedance2):

bash
uv run scripts/generate_video.py --prompt "A serene mountain landscape at sunrise with mist" --filename "2026-04-14-mountain-sunrise.mp4" --model seedance2 --ratio 1280:720

Image-to-video (animate a local product photo):

bash
uv run scripts/generate_video.py --prompt "Camera slowly zooms out, product sparkles" --image-url "./product.jpg" --filename "2026-04-14-product-reveal.mp4" --model seedance2 --ratio 720:1280

Video-to-video from a local file (seedance2):

bash
uv run scripts/generate_video.py --prompt "Transform into a warm golden sunset scene" --video-url "./input.mp4" --filename "2026-04-14-sunset-transform.mp4" --model seedance2

Fast draft:

bash
uv run scripts/generate_video.py --prompt "A cat playing piano" --filename "draft.mp4" --model veo3.1_fast --ratio 1280:720 --duration 4

Premium quality:

bash
uv run scripts/generate_video.py --prompt "Cinematic drone shot over Tokyo at night" --filename "tokyo.mp4" --model veo3 --ratio 1280:720 --duration 8

Output

The script downloads the result and saves it to the specified path
Script outputs the full path to the saved file
Do not read the video file back -- just inform the user of the saved path

Common Failures

Error: No API key -> set RUNWAYML_API_SECRET in the environment (e.g. export RUNWAYML_API_SECRET=... or a .env file).
Error: Task failed -- SAFETY.INPUT.* -> content moderation, suggest different prompt
Error: Task failed -- ASSET.INVALID -> bad input file format, check image/video format
API error 429 -> rate limited, script auto-retries

For Batch Generation

To generate many videos at once, run this script in a loop — the agent can orchestrate multiple calls with different prompts, images, or parameters to produce campaigns, localized variants, or creative iterations at scale.

Frequently asked questions

What does the Rw Generate Video AI skill do?

Generate videos directly using the Runway API via runnable scripts. Supports text-to-video, image-to-video, and video-to-video with seedance2, gen4.5, veo3, and more.

Why use Rw Generate Video on TypingMind?

Because you install it once and use it with any model. Rw Generate Video is plain Markdown rather than provider-specific code, so the same skill runs on GPT-5, Claude, Gemini, Grok, or a local model — and you can switch model mid-chat without it breaking. TypingMind runs on your own API keys, so you pay providers directly instead of a per-seat subscription, and your skills and chats stay in your own storage.

How do I install Rw Generate Video in TypingMind?

Open Plugins → Skills → Install from GitHub in TypingMind and paste https://github.com/runwayml/skills/tree/main/skills/rw-generate-video. TypingMind reads its SKILL.md and installs it as a skill you can enable per chat.

Which AI models can use Rw Generate Video?

Any model you connect in TypingMind. AI skills are plain Markdown instructions rather than provider-specific code, so GPT, Claude, Gemini, Grok, and local models can all load this skill when a request matches it.

How many AI models can I use with Rw Generate Video?

As many as you like. As long as a model supports skills, you can use Rw Generate Video with it — GPT, Claude, Gemini, Grok, DeepSeek, Mistral, Llama and more — all on TypingMind with your own API keys.

Is the Rw Generate Video AI skill free?

Yes. It is published on GitHub by runwayml under the MIT license. You only pay your own AI provider for the tokens you use.

What are AI skills?

An AI skill is a reusable instruction bundle that teaches an AI model how to do one specific task. It follows the open Agent Skills format: a SKILL.md file with a name and description, plus any scripts, templates or reference files the model may need. The model reads the instructions only when your request matches the skill, so an installed skill costs nothing until it is used.

How are AI skills different from plugins or MCP servers?

A plugin or MCP server gives a model new tools to call — code that runs somewhere and returns a result. An AI skill gives the model knowledge and process instead: how to approach a task, which steps to follow, what good output looks like. Skills are plain Markdown, so they need no server, no API key and no runtime, and they work with any model.

View all

Research

mattpocock

CommunityPopular

Investigate a question against high-trust primary sources and capture the findings as a Markdown file in the repo. Use when the user wants a topic researched, docs or API facts gathered, or reading…

Resolving Merge Conflicts

mattpocock

CommunityPopular

Use when you need to resolve an in-progress git merge/rebase conflict.

Setup Matt Pocock Skills

mattpocock

CommunityPopular

Configure this repo for the engineering skills: set up its issue tracker, triage label vocabulary, and domain doc layout. Run once before first use of the other engineering skills.

Tdd

Test-driven development. Use when the user wants to build features or fix bugs test-first, mentions "red-green-refactor", or wants integration tests.

Overview

Installation

Install in TypingMind

Install in another agent

Use it in TypingMind

Works with any AI model

Skill instructions

Generate Video

Usage

Preflight

Security Notes

Available Models

Model Selection Guidance

Parameters

Filename Convention

Examples

Output

Common Failures

For Batch Generation

Frequently asked questions

Related AI Skills

Set up your own AI workspace now