Sound Design Sync Illusion logo

Sound Design Sync Illusion

Community
geegl
sound-design-sync-illusion

Audiences believe any sound synchronized with image IS the image's sound. Real sounds often have poor dramatic effect; substitute sources work better.

Overview

Publishergeegl
Repositorydirectorskills
Skill namesound-design-sync-illusion
Stars
68
Forks
7
Bundled files
1
LicenseMIT
Links
  • Markdown instructions

    A SKILL.md file the model loads on demand, so it only costs tokens when a request actually matches.

  • Works with any LLM

    AI skills are plain Markdown, not provider-specific code, so this works with GPT, Claude, Gemini, Grok, or a local model.

  • 1 bundled files

    Scripts, templates, and references the model can read while it works. Files are read-only and never executed.

  • Open source

    Published by geegl on GitHub. Read the source before you install it.

Installation

Install the Sound Design Sync Illusion AI skill in TypingMind to use it with any LLM, or drop it into another agent that reads SKILL.md.

1

Install in TypingMind

TypingMind installs a skill straight from its GitHub folder — it reads SKILL.md, bundles the resource files, and stores the result locally.

  1. Open the app and go to Plugins → Skills.
  2. Choose "Install from GitHub".
  3. Paste the skill folder URL below and confirm.
    https://github.com/geegl/directorskills/tree/main/output/books/sound-design/sound-design-sync-illusion
  4. Enable the skill in any chat where you want it available.
Plugins → Skills → Add skill → From GitHub URL, then paste the folder URL and press Continue.
2

Install in another agent

Any agent that reads the Agent Skills format can use this skill — copy the folder into that agent's skills directory.

Claude Code — .claude/skills
git clone --depth 1 https://github.com/geegl/directorskills.git /tmp/directorskills
mkdir -p .claude/skills
cp -r /tmp/directorskills/output/books/sound-design/sound-design-sync-illusion .claude/skills/sound-design-sync-illusion
Restart Claude Code after copying so it picks up the new skill.

Use it in TypingMind

Enable Sound Design Sync Illusion in any TypingMind chat and the model takes it from there. Its name and description sit in the system prompt, and the moment a request matches, the model loads the full instructions itself — you never invoke it by hand, and it costs no tokens until it is actually used.

The model loads Sound Design Sync Illusion on its own as soon as a request matches it.

Works with any AI model

AI skills are plain Markdown instructions rather than provider-specific code, so Sound Design Sync Illusion is not tied to the model it was written for. Install it once in TypingMind and use it with GPT-5, Claude, Gemini, Grok, DeepSeek, Mistral, Llama, or a local model you run yourself — all on your own API keys.

  • Loaded only when it is needed

    The system prompt carries just the name and description. The instructions are fetched on the first matching request, so an idle skill costs nothing.

  • Switch models mid-chat

    Because the skill is instructions rather than code, changing model does not break it — the next model reads the same SKILL.md.

Skill instructions

This is the SKILL.md content the model loads. Read it before installing — a skill is instructions your model will follow.

RIA++ Skill: 声画同步幻觉原则 (Sound-Image Sync Illusion)

R — 原文 (Reading)

"观众会认为任何与画面同步的声音,就是该画面发出的声音。一些真实的声音戏剧效果并不好,而完全不同声源发出的声音效果却不错。" — 声音设计 — David Sonnenschein, p.g_0006

I — 方法论骨架 (Interpretation)

两个关键心理现象的结合:

  1. 同步幻觉:观众的大脑会自动将同步的声音归因于画面中的物体/动作,无论声音的真实来源是什么。
  2. 真实≠有效:真实世界的声音往往缺乏戏剧性,而替代声源可以更好地传达情绪和叙事。

这两个现象的结合创造了拟音(Foley)艺术的基础:

  • 打牛肉→拳击声(比真实拳头更有力)
  • 踩玉米淀粉→雪地行走声(比真实雪声更清晰)
  • 保龄球瓶倒下→人物摔倒声(比真实摔倒更有喜剧感)

A1 — 书中的应用 (Past Application)

案例 1:《夺宝奇兵》与《洛奇》的拟音替代声源

  • 问题:真实的鞭子声和拳击声在录音中缺乏戏剧冲击力,如何让观众"感觉"更真实?
  • 方法论的使用:鞭子声用特殊甩鞭技巧录制而非真实Indiana Jones的鞭子;拳击声用打牛肉和拍打皮革替代真实拳头接触。因为与画面严格同步,观众大脑自动将声音归因于画面中的动作——同步幻觉完美成立。
  • 结论:同步幻觉的核心法则——"听起来对"永远比"真的是这样"重要。观众的大脑不会验证声源,只验证同步性。

案例 2:《侏罗纪公园》恐龙吼声的多源合成

  • 问题:恐龙已灭绝,没有任何"真实"的恐龙声可用,如何让观众相信这些声音是真的?
  • 方法论的使用:加里·里德斯特罗姆将大象、老虎、鳄鱼、鲸鱼等多种动物声混合——每种来源都经过处理不可辨识。同步幻觉让观众完全接受这些从未存在的生物发出从未听过的声音。
  • 结论:同步幻觉的极限应用——当声源完全未知时(不存在的生物),只要同步性和情绪匹配度够高,观众会无条件接受任何声音。

A2 — 触发场景 (Future Trigger) ★

场景1:一个动作效果的真实录音效果不好。

  • 语言信号:"真实的声音太平淡了/没有冲击力。"

场景2:需要为一个不常见的动作创造声音。

  • 语言信号:"这个东西应该听起来怎样?"

场景3:声音和画面的同步点需要调整。

  • 语言信号:"声音和画面对不上/差一帧。"

E — 可执行步骤 (Execution)

  1. 声音实验:不要追求"真实"声源,尝试多种替代来源——厨房、工具间、身体

  2. 同步测试:将声音与画面同步播放,检查大脑是否接受这个"幻觉"

  3. 情绪匹配:选择最能传达场景情绪的声音,而非最"正确"的声音

    • 🔴 判停条件: 若声音实验后替代声源的"真实感"过低导致观众无法建立声画关联,回到步骤1尝试更接近原始声源特征的替代品;若同步测试发现哪怕1-2帧的偏差也会破坏幻觉,回到步骤2逐帧微调同步点直到大脑完全接受

B — 边界 (Boundary) ★

反场景:纪录片(需要真实声音)、新闻报道(真实性要求高)。

失败模式:

  • 同步偏差太大——观众注意到"声音不对"
  • 替代声源太明显——听出是拍打牛肉而非拳头
  • 过度夸张——在写实风格中使用卡通声效

反模式与常见错误

  • 不要追求"真实"而牺牲戏剧效果——真实拳头打击声可能只是闷响,而打牛肉的声音更有冲击力。声音设计的目的是传达情绪而非记录物理现实,"听起来对"比"真的是这样"更重要
  • 不要让替代声源过于明显——如果观众听出"这是拍打西瓜"而非"这是头部被击中",幻觉就破裂了。替代声源需要足够抽象或经过处理,使其与原始声源脱钩
  • 不要在写实风格影片中过度夸张同步效果——卡通风格的夸张声效(如弹簧声表示跳跃)在写实语境中会打破叙事一致性,必须根据影片的整体风格调校声音的"夸张度"

作者的盲点 / 时代局限

David Sonnenschein 的声音设计理论源自传统电影声音制作,对数字时代的新声音形态(如 ASMR、空间音频、AI 生成音效)覆盖不足。他假设声音设计师有专业录音棚和拟音资源,独立创作者的低成本声音解决方案讨论较少。书中理论框架偏重感知心理学,对文化差异导致的声音审美差异(如东西方对沉默的不同理解)涉及有限。

此外,声音同步幻觉的讨论偏重技术实现,对创意应用(如故意打破同步制造陌生化效果)讨论不足。此外,Sonnenschein 未充分讨论不同文化中对声音同步的期望差异——某些文化传统中非同步声音是常态而非缺陷。

Bundled files

The model reads these on demand while the skill is loaded. They are exposed as readable files and are never executed.

Frequently asked questions

What does the Sound Design Sync Illusion AI skill do?

Audiences believe any sound synchronized with image IS the image's sound. Real sounds often have poor dramatic effect; substitute sources work better.

Why use Sound Design Sync Illusion on TypingMind?

Because you install it once and use it with any model. Sound Design Sync Illusion is plain Markdown rather than provider-specific code, so the same skill runs on GPT-5, Claude, Gemini, Grok, or a local model — and you can switch model mid-chat without it breaking. TypingMind runs on your own API keys, so you pay providers directly instead of a per-seat subscription, and your skills and chats stay in your own storage.

How do I install Sound Design Sync Illusion in TypingMind?

Open Plugins → Skills → Install from GitHub in TypingMind and paste https://github.com/geegl/directorskills/tree/main/output/books/sound-design/sound-design-sync-illusion. TypingMind reads its SKILL.md and bundles its files and installs it as a skill you can enable per chat.

Which AI models can use Sound Design Sync Illusion?

Any model you connect in TypingMind. AI skills are plain Markdown instructions rather than provider-specific code, so GPT, Claude, Gemini, Grok, and local models can all load this skill when a request matches it.

How many AI models can I use with Sound Design Sync Illusion?

As many as you like. As long as a model supports skills, you can use Sound Design Sync Illusion with it — GPT, Claude, Gemini, Grok, DeepSeek, Mistral, Llama and more — all on TypingMind with your own API keys.

Is the Sound Design Sync Illusion AI skill free?

Yes. It is published on GitHub by geegl under the MIT license. You only pay your own AI provider for the tokens you use.

What are AI skills?

An AI skill is a reusable instruction bundle that teaches an AI model how to do one specific task. It follows the open Agent Skills format: a SKILL.md file with a name and description, plus any scripts, templates or reference files the model may need. The model reads the instructions only when your request matches the skill, so an installed skill costs nothing until it is used.

How are AI skills different from plugins or MCP servers?

A plugin or MCP server gives a model new tools to call — code that runs somewhere and returns a result. An AI skill gives the model knowledge and process instead: how to approach a task, which steps to follow, what good output looks like. Skills are plain Markdown, so they need no server, no API key and no runtime, and they work with any model.

View all

Set up your own AI workspace now

Get notified about new features and future giveaways by subscribing to our newsletter 👇